-- Logs begin at Tue 2022-06-21 02:21:19 UTC, end at Tue 2022-06-21 03:31:38 UTC. -- Jun 21 03:00:17.522690 dv-cinder-846842-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 03:00:17.531830 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 03:00:17 2022] *** Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: nodename: dv-cinder-846842-1-iscsi Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: machine: x86_64 Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: clock source: unix Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: pcre jit disabled Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: detected number of CPU cores: 4 Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: current working directory: / Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: detected binary path: /usr/bin/uwsgi-core Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: your processes number limit is 47680 Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: your memory page size is 4096 bytes Jun 21 03:00:17.534100 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: detected max file descriptor number: 2048 Jun 21 03:00:17.534891 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: lock engine: pthread robust mutexes Jun 21 03:00:17.534891 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: thunder lock: enabled Jun 21 03:00:17.534891 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 03:00:17.534891 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 03:00:17.577301 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: Python main interpreter initialized at 0x55e78f25c9c0 Jun 21 03:00:17.577301 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: python threads support enabled Jun 21 03:00:17.577301 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: your server socket listen backlog is limited to 100 connections Jun 21 03:00:17.577301 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: your mercy for graceful operations on workers is 90 seconds Jun 21 03:00:17.577659 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 03:00:17.577659 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: *** Operational MODE: preforking *** Jun 21 03:00:17.577945 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: *** uWSGI is running in multiple interpreter mode *** Jun 21 03:00:17.577945 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: spawned uWSGI master process (pid: 103269) Jun 21 03:00:17.578137 dv-cinder-846842-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 03:00:17.578640 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: spawned uWSGI worker 1 (pid: 103270, cores: 1) Jun 21 03:00:17.581342 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: spawned uWSGI worker 2 (pid: 103271, cores: 1) Jun 21 03:00:17.581342 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 03:00:18.227584 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 03:00:18.236779 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 03:00:19.367570 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:00:19.367570 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jun 21 03:00:19.368222 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:00:19.368222 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jun 21 03:00:19.379432 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:00:19.379432 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: from cryptography.utils import int_from_bytes Jun 21 03:00:19.379928 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:00:19.379928 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: from cryptography.utils import int_from_bytes Jun 21 03:00:21.810076 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 03:00:21.810772 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 03:00:21.810772 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 03:00:21.811184 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 03:00:21.811432 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 03:00:21.811825 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.812147 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.812461 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.812796 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.813140 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.813471 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.813770 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.814112 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.814421 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.814673 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.814983 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.815219 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 03:00:21.815617 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-1-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.815708 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 03:00:21.815796 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.815897 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.816177 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.816274 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 03:00:21.816514 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.816620 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 03:00:21.816800 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.816930 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 03:00:21.817116 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.817212 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.817416 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.817510 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.817806 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.817934 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.818124 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819097 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819204 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819276 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819352 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819426 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819492 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819556 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819626 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819700 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819773 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819845 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.819911 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.820109 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.820243 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.820396 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.820523 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-1-iscsi {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.820750 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.820852 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.821055 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.821154 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.821386 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.821472 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-1-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.821700 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.821786 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.822003 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.822096 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.822320 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.822455 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.822621 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.822715 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823008 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823110 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823308 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823426 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823622 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823718 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.823938 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.824033 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.824241 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.824328 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.824595 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.824703 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.824905 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825002 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825216 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825326 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825516 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825610 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825807 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.825898 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.826108 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.826206 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.826410 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.826513 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-1-iscsi {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.826719 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.826812 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827016 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827107 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827313 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827404 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827556 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827758 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.827842 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.828068 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.828168 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.828381 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.828511 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.828877 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.828989 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829085 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829215 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829331 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829426 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829573 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829708 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.829884 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830024 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830195 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830348 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830503 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830663 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830804 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.830963 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.831106 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.831266 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.831407 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.831568 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.831707 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.831879 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832007 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832176 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832307 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832515 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832646 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832765 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.832970 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833104 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833270 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833573 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833666 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833884 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.833968 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.834211 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.834340 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.834457 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.834557 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.834773 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.834866 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835089 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835185 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835396 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835488 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835694 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835784 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.835993 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.836088 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.836296 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.836386 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.836619 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.836704 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.836917 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.837012 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.837217 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.837303 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.837520 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.837612 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.837832 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838001 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838130 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838215 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838374 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838457 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838671 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838763 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.838969 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839054 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839277 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839402 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839577 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839664 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839878 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.839962 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.840184 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.840277 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.840497 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.840587 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.840801 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.840885 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841102 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841186 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841401 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841488 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841700 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841796 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.841999 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842085 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842295 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842381 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842595 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842679 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842893 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.842986 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.843190 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.843276 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.843454 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.843537 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.843752 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.843853 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.844053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.844145 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.844430 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.844644 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.844767 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.844931 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845094 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845194 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845322 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845408 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845622 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845717 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.845922 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846016 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846225 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846309 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846522 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846614 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846819 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.846911 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.847123 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.847257 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.847421 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.847515 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.847720 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.847815 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848022 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848115 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848314 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848399 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848651 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848737 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.848958 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849042 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849258 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849355 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849555 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849638 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849852 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.849949 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.850153 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.850238 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.850450 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.850541 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.850747 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.850831 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851044 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851165 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851339 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851424 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851632 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851717 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.851928 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852012 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852240 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852332 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852562 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852649 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852865 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.852958 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.853161 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.853298 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.853460 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.853553 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.853767 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.853851 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.854077 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.854173 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.854388 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.854483 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.854694 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.854786 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.854992 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.855076 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.855295 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.855395 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.855593 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.855677 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.855894 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.855984 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.856193 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.856292 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.856527 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.856615 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.856825 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.856912 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.857138 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.857224 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.857454 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.857545 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.857756 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.857842 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.858062 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.858147 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.858361 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.858447 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.858676 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.858760 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:00:21.858993 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.859080 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.859299 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.859384 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.859603 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.859694 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.859917 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860003 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860265 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860443 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860625 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860726 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.860997 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.861221 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.861308 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.861542 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.861627 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.861860 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.861945 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.862172 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.862264 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.862479 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.862573 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.862780 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.862876 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.863086 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.863177 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.863392 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.863485 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.863710 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.863796 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864021 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864111 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864328 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864445 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864665 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864750 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.864969 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865054 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865272 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865369 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865575 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865660 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865880 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.865966 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.866182 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.866267 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.866509 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.866593 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.866817 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.866907 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.867125 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.867219 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.867430 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.867522 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.867739 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.867823 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868039 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868124 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868340 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868443 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868677 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868772 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.868973 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869058 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869271 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869569 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869664 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869877 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.869962 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.870174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.870270 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.870492 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.870595 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.870804 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.870916 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.871095 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.871199 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.871407 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.871501 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.871704 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.871787 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872008 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872152 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872294 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872511 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872643 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872777 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.872915 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873047 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873203 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873345 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873511 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873630 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873810 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.873901 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.874106 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.874194 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.874405 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.874500 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.874706 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.874844 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875003 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875131 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875301 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875430 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875669 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875805 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.875995 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.876127 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.876642 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.876734 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.876970 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877055 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877275 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877370 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877581 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877670 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877887 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.877987 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.878194 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.878278 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.878492 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.878584 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.878798 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.878901 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.879106 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.879190 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.879407 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.879493 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.879721 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.879814 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880028 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880111 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880331 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880443 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880654 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880751 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.880964 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881049 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881260 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881343 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881556 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881649 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881855 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.881940 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.882158 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.882253 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.882455 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.882615 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.882755 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.882841 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883056 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883148 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883352 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883439 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883655 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883791 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.883970 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.884108 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.884280 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.884477 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.884608 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.884743 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.884887 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885025 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885307 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885500 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885629 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885781 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.885922 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.886083 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.886216 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.886386 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.886526 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.886689 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.886898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887041 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887173 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887311 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887443 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887584 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887723 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.887866 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888000 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888132 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888275 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888433 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888573 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888706 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.888840 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889020 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889163 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889310 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889442 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889610 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889743 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.889906 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890039 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890192 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890326 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890529 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890663 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890833 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.890979 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.891120 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.891310 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.891447 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.891580 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.891775 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.891956 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.892099 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.892241 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.892396 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.892783 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.892783 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893058 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893192 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893325 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893458 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893597 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893736 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893834 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893916 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.893994 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.894189 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.894274 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.894490 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.894586 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.894801 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.894885 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.895100 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.895192 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.895407 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.895509 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.895708 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.895791 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896020 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896105 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896317 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896402 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896652 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896737 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.896952 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897042 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897266 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897353 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897590 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897687 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.897994 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.898207 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.898293 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.898510 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.898594 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.898820 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.898903 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.899127 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.899219 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.899425 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.899515 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.899723 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.899816 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900026 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900117 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900323 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900435 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900654 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900751 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.900954 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901037 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901261 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901351 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901560 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901653 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901854 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.901944 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.902158 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.902286 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.902459 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.902554 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.902760 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.902853 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903058 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903143 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903361 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903447 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903676 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903809 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.903981 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.904073 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.904287 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.904380 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.904615 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.904703 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.904911 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905038 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905209 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905303 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905510 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905594 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905809 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.905892 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.906107 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.906193 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.906404 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.906488 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.906702 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.906833 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.907094 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.907221 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.907417 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.907572 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.907707 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.907802 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908007 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908093 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908307 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908393 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908635 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908735 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.908945 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909037 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909247 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909344 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909641 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909869 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.909953 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.910169 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.910254 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.910469 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.910567 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.910770 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.910854 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911074 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911372 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911467 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911673 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911758 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.911975 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.912060 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.912279 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.912391 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.912609 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.912700 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.912915 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913003 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913209 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913305 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913526 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913618 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913852 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.913967 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.914133 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.914384 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.914472 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.914714 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.914800 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915025 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915128 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915330 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915440 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915639 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915742 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.915947 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916049 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916254 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916341 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916677 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916900 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.916988 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.917222 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.917331 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.917535 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.917619 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.917833 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.917945 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.918135 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.918237 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.918430 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.918515 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.918726 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.918820 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.919026 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.919119 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.919331 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.919613 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.919720 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.919931 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920023 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920232 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920318 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920555 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920677 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920856 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.920943 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.921164 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.921249 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.921462 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.921562 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.921768 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.921854 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.922071 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.922156 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.922392 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.922485 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.922719 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.922813 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923017 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923103 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923323 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923409 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923607 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923693 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.923957 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924053 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924200 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924295 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924522 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924624 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924833 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.924926 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.925135 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.925230 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.925438 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.925524 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.925739 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.925828 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926044 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926138 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926353 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926439 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926651 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926737 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.926946 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927039 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927247 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927339 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927546 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927638 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927842 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.927929 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.928138 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.928230 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.928452 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.928539 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.928753 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.928853 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929052 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929136 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929349 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929434 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929655 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929742 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.929949 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930035 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930257 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930342 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930558 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930644 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930855 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.930948 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.931151 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.931245 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.931454 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.931540 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.931754 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.931840 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932057 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932151 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932358 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932463 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932688 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932781 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.932986 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.933084 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.933278 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.933364 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.933579 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.933706 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.933873 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934018 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934194 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934303 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934456 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934568 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934749 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.934860 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935042 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935127 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935354 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935447 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935650 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935735 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.935944 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936035 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936243 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936328 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936566 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936656 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936864 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.936951 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.937157 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.937242 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.937462 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.937557 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.937760 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.937847 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.938076 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.938312 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.938423 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.938515 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.938727 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.938813 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939024 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939118 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939329 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939422 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939641 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939726 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.939942 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940036 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940261 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940354 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940593 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940680 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940895 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.940994 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.941197 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.941282 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.941497 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.941582 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.941802 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.941888 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.942098 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.942182 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.942398 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.942483 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.942697 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.942783 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943009 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943092 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943309 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943393 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943616 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943701 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.943917 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944002 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944224 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944344 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944548 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944659 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944852 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.944947 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.945150 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.945246 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.945455 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.945601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.945741 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.945871 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946042 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946185 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946328 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946460 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946641 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946769 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.946940 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947082 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947219 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947352 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947519 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947656 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947817 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.947971 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.948125 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.948263 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.948455 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.948544 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.948774 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.948875 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.949101 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.949195 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.949391 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.949515 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.949702 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.949790 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950004 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950087 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950302 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950394 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950606 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950693 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.950910 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951001 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951212 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951296 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951516 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951602 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951817 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.951911 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.952113 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.952199 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.952444 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.952534 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.952740 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.952835 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.953043 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.953142 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.953352 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.953438 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.953637 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.953721 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954008 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954198 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954307 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954523 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954628 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954823 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.954952 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.955130 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.955216 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.955443 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.955529 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.955739 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.955834 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956041 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956156 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956346 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956498 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956679 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956809 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.956994 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.957107 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.957308 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.957415 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.957621 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.957719 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.957929 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958067 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958222 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958306 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958525 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958630 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958830 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.958999 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.959129 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.959306 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.959447 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.959618 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.959762 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.959925 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960062 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960224 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960367 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960545 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960690 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960850 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.960996 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.961167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.961294 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.961467 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.961721 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.961813 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962031 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962122 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962338 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962425 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962639 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962729 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.962945 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963084 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963250 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963344 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963562 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963686 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963872 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.963968 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.964176 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.964312 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.964609 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.964707 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.964917 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965020 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965224 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965309 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965529 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965621 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965830 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.965925 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.966127 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.966222 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.966426 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.966519 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.966725 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.966888 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967029 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967122 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967330 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967416 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967631 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967716 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.967935 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.968019 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.968234 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.968320 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.968573 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.968663 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.968890 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.969000 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.969198 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.969291 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.969589 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.969678 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970004 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970320 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970407 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970625 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970711 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.970939 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971042 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971256 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971344 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971553 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971638 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971853 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.971953 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.972157 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.972247 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.972477 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.972582 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.972780 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.972870 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.973097 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.973187 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.973399 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.973493 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.973706 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.973791 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974005 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974089 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974307 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974405 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974626 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974764 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974911 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.974998 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.975285 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.975526 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.975631 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.975889 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.975992 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.976205 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.976310 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.976548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.976644 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.976868 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.976962 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.977164 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.977351 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.977480 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.977585 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.977777 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.977861 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978072 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978168 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978371 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978456 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978665 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978750 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.978983 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979076 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979282 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979375 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979585 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979680 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979900 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.979987 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.980204 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.980289 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.980529 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.980620 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.980831 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.980920 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.981150 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.981244 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.981452 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.981538 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.981760 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.981854 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982065 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982157 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982368 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982454 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982669 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982757 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.982974 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983102 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983270 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983364 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983570 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983663 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983866 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.983956 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.984162 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.984263 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.984475 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.984577 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.984775 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.984861 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.985098 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.985192 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.985415 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.985594 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.985710 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.985930 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986017 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986258 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986352 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986566 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986662 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986876 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.986969 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.987174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.987260 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.987500 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.987592 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.987796 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.987889 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.988122 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.988215 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.988432 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.988520 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.988738 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.988839 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989044 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989130 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989346 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989431 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989646 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989740 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.989950 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990042 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990254 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990347 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990551 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990645 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990850 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.990936 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.991150 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.991236 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.991456 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.991549 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.991751 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.991836 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992056 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992141 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992354 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992470 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992689 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992776 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.992983 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.993068 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.993282 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.993499 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.993615 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.993838 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.993933 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.994127 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.994216 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.994434 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.994521 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.994742 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.994830 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995145 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995356 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995444 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995662 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995750 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.995965 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996268 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996354 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996598 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996701 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996913 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.996998 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.997222 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.997316 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.997533 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.997628 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.997849 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.997935 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.998153 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.998240 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.998457 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.998552 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.998763 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.998892 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.999067 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.999153 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.999418 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.999577 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.999735 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:21.999902 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.000037 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.000216 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.000344 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.000591 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.000762 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.000935 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.001142 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.001556 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.001660 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.001867 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.001954 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.002177 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.002264 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.002484 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.002571 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.002786 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.002873 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.003089 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.003174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.003390 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.003485 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.003696 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.003784 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004016 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004103 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004341 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004465 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004677 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004782 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.004981 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.005089 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.005287 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.005373 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.005591 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.005676 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.005939 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.006103 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.006252 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.006398 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.006554 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.006726 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.006863 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007045 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007174 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007363 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007483 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007675 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007774 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.007988 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.008073 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.008312 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.008400 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.008640 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.008739 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.008941 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009035 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009248 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009334 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009553 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009648 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009857 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.009950 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.010174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.010260 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.010481 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.010568 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.010780 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.010865 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.011093 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.011192 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.011396 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.011489 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.011705 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.011917 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.012219 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.012305 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.012564 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.012666 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.012888 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.012974 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.013204 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.013288 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.013514 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.013607 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.013816 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.013902 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.014126 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.014220 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.014424 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.014509 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.014725 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.014819 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015022 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015158 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015330 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015424 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015625 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015718 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.015927 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.016054 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.016254 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.016368 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.016584 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.016698 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.016894 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.017056 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.017213 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.017366 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.017520 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.017668 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.017993 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.018106 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.018296 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.018399 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.018597 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.018691 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.018897 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019010 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019203 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019332 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019503 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019601 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019808 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.019901 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.020107 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.020195 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.020406 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.020562 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.020735 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.020822 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021038 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021126 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021344 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021439 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021646 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021733 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.021946 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022031 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022241 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022339 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022544 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022631 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022840 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.022925 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.023147 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.023241 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.023451 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.023559 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.023758 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.023862 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024061 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024168 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024362 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024469 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024686 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024790 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.024993 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025080 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025298 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025393 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025595 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025681 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025896 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.025990 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.026195 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.026431 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.026519 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.026760 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.026865 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027078 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027163 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027376 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027464 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027691 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027786 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.027992 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.028079 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.028300 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.028385 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.028628 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.028717 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.028949 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.029035 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.029260 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.029361 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.029554 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.029687 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.029864 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030003 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030176 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030308 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030462 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030603 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030767 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.030897 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.031070 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.031213 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.031374 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.031511 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.031679 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.031847 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.032091 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.032403 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.032514 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.032726 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.032813 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033030 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033117 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033339 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033428 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033682 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033785 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.033998 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.034103 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.034310 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.034396 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.034614 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.034708 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.034922 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035228 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035316 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035533 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035620 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035835 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.035929 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.036139 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.036226 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.036462 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.036552 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.036771 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.036871 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037077 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037163 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037374 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037678 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037772 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.037993 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.038079 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.038302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.038388 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.038609 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.038696 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.038914 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039000 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039225 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039311 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039560 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039662 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039873 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.039967 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.040189 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.040283 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.040527 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.040625 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.040840 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.040926 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.041147 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.041245 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.041455 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.041541 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.041767 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.041867 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042062 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042157 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042362 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042447 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042661 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042753 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.042966 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043055 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043263 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043347 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043568 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043675 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043869 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.043966 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.044164 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.044278 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.044490 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.044620 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.044792 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.044926 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045090 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045242 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045392 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045558 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045689 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045866 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.045992 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.046185 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.046291 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.046491 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.046584 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.046817 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.046912 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.047151 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.047238 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.047466 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.047631 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.047794 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.047926 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.048147 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.048306 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.048471 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.048604 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.048744 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.048878 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049010 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049149 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049282 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049415 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049559 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049683 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049871 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.049968 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.050175 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.050261 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.050481 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.050623 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.050780 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.050875 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051096 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051197 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051375 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051469 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051672 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051766 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.051977 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052062 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052274 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052368 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052604 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052693 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052898 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.052984 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.053195 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.053283 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.053501 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.053589 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.053798 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.053899 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054100 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054211 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054395 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054481 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054693 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054779 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.054989 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055075 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055285 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055372 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055676 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055903 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.055997 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.056224 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.056310 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.056551 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.056640 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.056863 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.056961 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.057166 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.057258 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.057470 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.057556 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.057768 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.057862 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058084 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058181 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058381 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058479 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058693 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058780 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.058994 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.059080 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.059299 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.059393 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.059606 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.059691 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.059920 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060013 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060271 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060377 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060552 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060640 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060862 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.060957 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.061170 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.061257 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.061491 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.061577 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.061811 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.061905 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.062115 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.062210 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.062435 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.062530 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.062747 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.062842 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.063065 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.063264 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.063445 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.063540 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.063756 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.063958 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.064081 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.064202 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 03:00:22.064390 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.064716 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.065030 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.065339 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.065646 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.065958 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.066269 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.066592 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.066916 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.067225 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.067546 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.067866 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.068210 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.068540 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.068879 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.069203 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.069516 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.069830 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.070131 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:00:22.070370 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 03:00:22.219570 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Registered counter for database nova_api Jun 21 03:00:22.227460 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Registered counter for database nova_api Jun 21 03:00:22.239735 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.246549 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.247281 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.254268 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.303602 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.context [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4968fc3d-d05a-41d1-aa8d-490f1ec89c5c(cell1) {{(pid=103271) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 03:00:22.307557 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:00:22.309167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:00:22.309961 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:00:22.310720 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.context [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4968fc3d-d05a-41d1-aa8d-490f1ec89c5c(cell1) {{(pid=103270) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 03:00:22.311909 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:00:22.313954 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Registered counter for database nova_cell0 Jun 21 03:00:22.314655 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:00:22.316231 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:00:22.317330 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:00:22.318008 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Registered counter for database nova_cell1 Jun 21 03:00:22.319282 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:00:22.321290 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Registered counter for database nova_cell0 Jun 21 03:00:22.325389 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Registered counter for database nova_cell1 Jun 21 03:00:22.325781 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.327533 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.332478 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.334152 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.335748 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.335862 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.339107 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.475989 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.478176 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Registered counter for database nova_cell0 Jun 21 03:00:22.485460 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.486505 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Registered counter for database nova_cell0 Jun 21 03:00:22.490623 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.495366 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:00:22.500541 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:00:22.825155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:00:22.827698 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:00:22.832445 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:00:22.836373 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:00:23.175627 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:00:23.178728 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:00:23.181689 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:00:23.184747 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:00:23.187055 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e78f25c9c0 pid: 103270 (default app) Jun 21 03:00:23.189191 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:00:23.190077 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e78f25c9c0 pid: 103271 (default app) Jun 21 03:00:23.190388 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-c76dd857-b337-4298-b869-b2b4e86094eb None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Jun 21 03:00:23.190801 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Tue Jun 21 03:00:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:38.010468 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:38.011926 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Jun 21 03:01:38.013197 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:38.035933 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_api:SELECT=3 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:38.037429 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_cell0:SELECT=3 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:38.038428 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_cell1:SELECT=3 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:38.039658 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:38.508204 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3a858cdd-9b77-4b21-ad32-c238656e5db3 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:38.538349 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3a858cdd-9b77-4b21-ad32-c238656e5db3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.518410 Jun 21 03:01:38.539179 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jun 21 03:01:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:01:40.619628 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:40.620560 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0271d1fc-18a9-40bf-bb3b-0395cb6dfb81 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 21 03:01:40.620926 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:40.684752 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-bf19201d-a728-459e-9fc6-e058b8e1131a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:40.705137 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:01:40.705137 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: warnings.warn(msg) Jun 21 03:01:40.736315 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-bf19201d-a728-459e-9fc6-e058b8e1131a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108953 Jun 21 03:01:40.736905 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 03:01:40.963875 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-220aaac3-34dc-4130-be3d-018d44ed8d7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:40.966262 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:01:40.966262 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jun 21 03:01:40.986400 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:40.987361 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:40.988717 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:40.989607 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:01:41.034265 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-220aaac3-34dc-4130-be3d-018d44ed8d7c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288473 Jun 21 03:01:41.035308 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jun 21 03:01:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:01:43.091699 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-bf19201d-a728-459e-9fc6-e058b8e1131a admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:43.092709 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-bf19201d-a728-459e-9fc6-e058b8e1131a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 21 03:01:43.093158 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:43.198746 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d1c874a7-4f2c-4e5c-a935-9f6c7869b334 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:43.216094 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:01:43.216094 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jun 21 03:01:43.243114 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d1c874a7-4f2c-4e5c-a935-9f6c7869b334 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143986 Jun 21 03:01:43.243674 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:01:43.256347 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-9a4369d6-6a95-4d6f-a81f-c792bc937403 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:43.257866 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:01:43.257866 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: warnings.warn(msg) Jun 21 03:01:43.291703 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-9a4369d6-6a95-4d6f-a81f-c792bc937403 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039227 Jun 21 03:01:43.292296 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jun 21 03:01:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:01:45.352575 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d1c874a7-4f2c-4e5c-a935-9f6c7869b334 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:45.353688 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d1c874a7-4f2c-4e5c-a935-9f6c7869b334 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 21 03:01:45.354316 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:45.417526 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-1ece8bba-ac70-4538-a743-d08a1fd16b7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:45.438056 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-1ece8bba-ac70-4538-a743-d08a1fd16b7f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077996 Jun 21 03:01:45.438961 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 03:01:45.450724 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d29aa64e-3e2d-41b8-86ac-5caa6196b576 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:45.474017 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d29aa64e-3e2d-41b8-86ac-5caa6196b576 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026944 Jun 21 03:01:45.474691 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jun 21 03:01:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:01:47.530047 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-1ece8bba-ac70-4538-a743-d08a1fd16b7f admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:47.531069 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-1ece8bba-ac70-4538-a743-d08a1fd16b7f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 21 03:01:47.531481 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:47.591433 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4faad2cc-ea48-42c9-aeb4-a7812909dd87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:47.610646 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-4faad2cc-ea48-42c9-aeb4-a7812909dd87 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073145 Jun 21 03:01:47.611225 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:01:47.623361 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-1114d4b3-802f-421c-b662-ca438bef6709 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:47.648141 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-1114d4b3-802f-421c-b662-ca438bef6709 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028544 Jun 21 03:01:47.648735 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jun 21 03:01:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:01:49.741412 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4faad2cc-ea48-42c9-aeb4-a7812909dd87 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:49.742427 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-4faad2cc-ea48-42c9-aeb4-a7812909dd87 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 21 03:01:49.742793 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:49.809365 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-0c18eaab-b83e-466a-9e0a-ecd293fe8167 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:49.832760 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-0c18eaab-b83e-466a-9e0a-ecd293fe8167 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083866 Jun 21 03:01:49.833483 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:01:49.846092 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-84aa8c6f-7409-42f2-98ee-1ac200d516bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:49.870224 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-84aa8c6f-7409-42f2-98ee-1ac200d516bf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027867 Jun 21 03:01:49.870776 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jun 21 03:01:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:01:51.990377 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-0c18eaab-b83e-466a-9e0a-ecd293fe8167 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:51.991413 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-0c18eaab-b83e-466a-9e0a-ecd293fe8167 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 21 03:01:51.992013 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:52.058151 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-030820f7-f878-4167-8588-148e804e9d3d admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:52.080944 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-030820f7-f878-4167-8588-148e804e9d3d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082042 Jun 21 03:01:52.081793 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jun 21 03:01:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:01:54.206808 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-0c18eaab-b83e-466a-9e0a-ecd293fe8167 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:54.208806 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-0c18eaab-b83e-466a-9e0a-ecd293fe8167 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002924 Jun 21 03:01:54.209685 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:01:54.309554 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5881358b-72b1-416b-8c87-3145192e8163 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "ram": 512, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:54.330264 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5881358b-72b1-416b-8c87-3145192e8163 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.110120 Jun 21 03:01:54.330862 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:01:54.344122 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-b8d86174-3eb9-45ba-aa2c-b583b3d626b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:54.369486 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-b8d86174-3eb9-45ba-aa2c-b583b3d626b0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029510 Jun 21 03:01:54.370215 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jun 21 03:01:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:01:56.452785 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5881358b-72b1-416b-8c87-3145192e8163 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:56.453803 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5881358b-72b1-416b-8c87-3145192e8163 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 21 03:01:56.454208 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:01:56.520675 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-84a8d06f-e6e5-4bf1-9e30-7b33de3c97a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "2"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:56.539433 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-84a8d06f-e6e5-4bf1-9e30-7b33de3c97a8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079005 Jun 21 03:01:56.540021 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 03:01:56.552596 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-193fd308-f0f9-46ee-8160-08b7c73d4346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:56.576578 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-193fd308-f0f9-46ee-8160-08b7c73d4346 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028080 Jun 21 03:01:56.577168 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jun 21 03:01:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:01:58.664310 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-84a8d06f-e6e5-4bf1-9e30-7b33de3c97a8 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:01:58.665396 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-84a8d06f-e6e5-4bf1-9e30-7b33de3c97a8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 21 03:01:58.665854 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:01:58.728597 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f85ea6e1-543d-4815-b544-441bd20d1a50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:58.748201 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f85ea6e1-543d-4815-b544-441bd20d1a50 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076233 Jun 21 03:01:58.748765 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:01:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:01:58.761526 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-b42d6f58-508f-4d8f-8516-e80f3aedb6e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:01:58.786705 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-b42d6f58-508f-4d8f-8516-e80f3aedb6e0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028788 Jun 21 03:01:58.787260 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jun 21 03:01:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:02:00.846090 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f85ea6e1-543d-4815-b544-441bd20d1a50 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:00.847212 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f85ea6e1-543d-4815-b544-441bd20d1a50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Jun 21 03:02:00.847609 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:00.910042 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-6977c9f8-4891-4b3f-8080-fd35546b2d0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:00.929505 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-6977c9f8-4891-4b3f-8080-fd35546b2d0a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076047 Jun 21 03:02:00.930036 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:02:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:02:00.942178 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-47682e85-9e20-4174-a121-aa7745d21243 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:00.965091 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-47682e85-9e20-4174-a121-aa7745d21243 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026760 Jun 21 03:02:00.965660 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jun 21 03:02:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:02:03.015100 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-6977c9f8-4891-4b3f-8080-fd35546b2d0a admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:03.016106 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-6977c9f8-4891-4b3f-8080-fd35546b2d0a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 21 03:02:03.016569 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:02:03.077873 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d349289f-4909-4315-983d-66a3bb29ecec admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:03.096465 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d349289f-4909-4315-983d-66a3bb29ecec admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073431 Jun 21 03:02:03.097379 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jun 21 03:02:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 03:02:03.109166 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3643cd3f-4324-4350-a49a-4e5208a12194 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:03.134518 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3643cd3f-4324-4350-a49a-4e5208a12194 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028822 Jun 21 03:02:03.134998 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jun 21 03:02:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:02:27.697977 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d349289f-4909-4315-983d-66a3bb29ecec admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:27.699027 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d349289f-4909-4315-983d-66a3bb29ecec admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 21 03:02:27.699453 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:27.710546 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:02:27.761097 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-45b25150-3ab6-4100-9327-397e33e20bc9 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:27.778814 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-45b25150-3ab6-4100-9327-397e33e20bc9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073098 Jun 21 03:02:27.779328 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jun 21 03:02:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:02:28.689669 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d349289f-4909-4315-983d-66a3bb29ecec admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:28.690664 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d349289f-4909-4315-983d-66a3bb29ecec admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 21 03:02:28.691090 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:28.893080 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-19db3616-e1b0-4961-9c70-2e5e1ff19b7b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:28.899069 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.wsgi [None req-19db3616-e1b0-4961-9c70-2e5e1ff19b7b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-19db3616-e1b0-4961-9c70-2e5e1ff19b7b admin admin] Request method failure captured: Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Accept: application/json Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Accept-Encoding: gzip, deflate Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Connection: keep-alive Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Content-Length: 0 Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Host: 10.222.0.16 Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Openstack-Api-Version: compute 2.90 Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Openstack-System-Scope: None Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: User-Agent: python-novaclient Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Auth-Token: gAAAAABisTTEteSOrJ3Y0kjAp15nFDbIXcY6YZQKiqNhAxOy2W-eWu9azyQGNbotRzUHrOAHd0GNSlACsj5R_E5RGMbF0A5_1n3ilF65xAFw4M2214ta5v_LZb_-XrPQptgQtDsvs-S4WfE_QzRyzEKSmjnalrxwl8xDm2yjIVHkotK_woZnOyk Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Domain-Id: None Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Domain-Name: None Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Identity-Status: Confirmed Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Is-Admin-Project: True Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Domain-Id: default Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Domain-Name: Default Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Name: admin Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Role: admin,member,reader Jun 21 03:02:28.902302 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Roles: admin,member,reader Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eab06a8b789343a7bc8eebc83d2a6637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant: admin Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant-Name: admin Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User: admin Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Domain-Id: default Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Domain-Name: Default Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Id: b424d6dcd2eb40949197b229df3c84e2 Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Name: admin Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: method: > Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: exception: Flavor 42 could not be found. Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: action_args: {'id': '42'} Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:02:28.903856 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:28.905053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.906459 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-19db3616-e1b0-4961-9c70-2e5e1ff19b7b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:02:28.907738 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-19db3616-e1b0-4961-9c70-2e5e1ff19b7b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.079133 Jun 21 03:02:28.907738 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jun 21 03:02:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 03:02:28.916340 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7b4d1255-263b-43a6-9960-797c7c6588e1 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:28.920584 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:02:28.940960 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-7b4d1255-263b-43a6-9960-797c7c6588e1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030526 Jun 21 03:02:28.941496 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jun 21 03:02:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:02:28.951677 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-5e2f1449-15fc-4fc4-b5b1-209ec2d4b2aa admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:28.975350 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-5e2f1449-15fc-4fc4-b5b1-209ec2d4b2aa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027431 Jun 21 03:02:28.975891 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jun 21 03:02:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:02:28.985447 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4643b220-5b68-4158-9144-ce415082cae8 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:28.991655 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-4643b220-5b68-4158-9144-ce415082cae8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4643b220-5b68-4158-9144-ce415082cae8 admin admin] Request method failure captured: Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Accept: application/json Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Host: 10.222.0.16 Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABisTTEteSOrJ3Y0kjAp15nFDbIXcY6YZQKiqNhAxOy2W-eWu9azyQGNbotRzUHrOAHd0GNSlACsj5R_E5RGMbF0A5_1n3ilF65xAFw4M2214ta5v_LZb_-XrPQptgQtDsvs-S4WfE_QzRyzEKSmjnalrxwl8xDm2yjIVHkotK_woZnOyk Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Role: admin,member,reader Jun 21 03:02:28.994898 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Roles: admin,member,reader Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eab06a8b789343a7bc8eebc83d2a6637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User: admin Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Id: b424d6dcd2eb40949197b229df3c84e2 Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: method: > Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: exception: Flavor 42 could not be found. Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: action_args: {'id': '42'} Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:02:28.996441 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:28.997539 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:28.998601 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4643b220-5b68-4158-9144-ce415082cae8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:02:28.999991 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-4643b220-5b68-4158-9144-ce415082cae8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014441 Jun 21 03:02:28.999991 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jun 21 03:02:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 03:02:29.816309 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-5e2f1449-15fc-4fc4-b5b1-209ec2d4b2aa admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:29.817354 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-5e2f1449-15fc-4fc4-b5b1-209ec2d4b2aa admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 21 03:02:29.817751 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:30.017717 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d134907a-f086-4e53-af5d-9dab9eecdb15 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:30.027158 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-d134907a-f086-4e53-af5d-9dab9eecdb15 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d134907a-f086-4e53-af5d-9dab9eecdb15 admin admin] Request method failure captured: Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Accept: application/json Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Host: 10.222.0.16 Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABisTTFkzB0BP_zXwXuwqs8EoJqpNYSVc0XyHpKrS5fOssbuYzuM5yakBRD1VcNQttMypY-9ajRN-3ngytleEGkMIojuYnLRssHVx5EQ0HveLT0dkNXSiuT_RpQz7ARRIfycy9OJIWPFMLTyFBqwj6-OKO-aCqWy8ekbMDwS2ior2S3OLY Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Role: admin,member,reader Jun 21 03:02:30.029548 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Roles: admin,member,reader Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eab06a8b789343a7bc8eebc83d2a6637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User: admin Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Id: b424d6dcd2eb40949197b229df3c84e2 Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: method: > Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: exception: Flavor 84 could not be found. Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: action_args: {'id': '84'} Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:02:30.031249 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:30.033227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.034904 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d134907a-f086-4e53-af5d-9dab9eecdb15 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:02:30.036231 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d134907a-f086-4e53-af5d-9dab9eecdb15 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076864 Jun 21 03:02:30.036231 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jun 21 03:02:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 03:02:30.041897 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3bbd30a7-692e-432c-a5f1-bc37b06adf0f admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:30.058379 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3bbd30a7-692e-432c-a5f1-bc37b06adf0f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020163 Jun 21 03:02:30.058963 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jun 21 03:02:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:02:30.071686 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0b444a5f-0f4a-4aba-8b22-a649454f5d9f admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:30.090311 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0b444a5f-0f4a-4aba-8b22-a649454f5d9f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024682 Jun 21 03:02:30.090839 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jun 21 03:02:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:02:30.102392 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-fd62ebf0-78b6-403f-abb9-0babebc11d18 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:30.108024 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.wsgi [None req-fd62ebf0-78b6-403f-abb9-0babebc11d18 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-fd62ebf0-78b6-403f-abb9-0babebc11d18 admin admin] Request method failure captured: Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Accept: application/json Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Accept-Encoding: gzip, deflate Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Connection: keep-alive Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Content-Length: 0 Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Host: 10.222.0.16 Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Openstack-Api-Version: compute 2.90 Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Openstack-System-Scope: None Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: User-Agent: python-novaclient Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Auth-Token: gAAAAABisTTFkzB0BP_zXwXuwqs8EoJqpNYSVc0XyHpKrS5fOssbuYzuM5yakBRD1VcNQttMypY-9ajRN-3ngytleEGkMIojuYnLRssHVx5EQ0HveLT0dkNXSiuT_RpQz7ARRIfycy9OJIWPFMLTyFBqwj6-OKO-aCqWy8ekbMDwS2ior2S3OLY Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Domain-Id: None Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Domain-Name: None Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Identity-Status: Confirmed Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Is-Admin-Project: True Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Domain-Id: default Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Domain-Name: Default Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Name: admin Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Role: admin,member,reader Jun 21 03:02:30.109589 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Roles: admin,member,reader Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eab06a8b789343a7bc8eebc83d2a6637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant: admin Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant-Name: admin Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User: admin Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Domain-Id: default Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Domain-Name: Default Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Id: b424d6dcd2eb40949197b229df3c84e2 Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Name: admin Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: method: > Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: exception: Flavor 84 could not be found. Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: action_args: {'id': '84'} Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:02:30.111090 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:30.112325 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:30.114506 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-fd62ebf0-78b6-403f-abb9-0babebc11d18 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:02:30.117204 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-fd62ebf0-78b6-403f-abb9-0babebc11d18 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012165 Jun 21 03:02:30.117204 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jun 21 03:02:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 03:02:30.937717 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0b444a5f-0f4a-4aba-8b22-a649454f5d9f admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:30.938716 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0b444a5f-0f4a-4aba-8b22-a649454f5d9f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 21 03:02:30.939089 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:31.151618 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7b06f6ae-d413-4df2-9823-620aa22529c0 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:31.157890 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.wsgi [None req-7b06f6ae-d413-4df2-9823-620aa22529c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7b06f6ae-d413-4df2-9823-620aa22529c0 admin admin] Request method failure captured: Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Accept: application/json Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Accept-Encoding: gzip, deflate Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Connection: keep-alive Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Content-Length: 0 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Host: 10.222.0.16 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Openstack-Api-Version: compute 2.90 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Openstack-System-Scope: None Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: User-Agent: python-novaclient Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Auth-Token: gAAAAABisTTGfKG66n5duku8T8j2BV7N8fRT-6nLBLDvax0iqCeRVPs13MbFBfvs1SkJF3BekP8noejLAzKqbMgO1dj1VKfRYMHbKsg_25Fc9z58d6nt7UiRF2qXI-Nr3Ys-tgcy-csY4MaHj7ET7sznRnw922V_f4GXjiY_yDvHBuxxoQPdAN0 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Domain-Id: None Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Domain-Name: None Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Identity-Status: Confirmed Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Is-Admin-Project: True Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Domain-Id: default Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Domain-Name: Default Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Project-Name: admin Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Role: admin,member,reader Jun 21 03:02:31.159356 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Roles: admin,member,reader Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eab06a8b789343a7bc8eebc83d2a6637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant: admin Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-Tenant-Name: admin Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User: admin Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Domain-Id: default Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Domain-Name: Default Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Id: b424d6dcd2eb40949197b229df3c84e2 Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: X-User-Name: admin Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: method: > Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: exception: Flavor 451 could not be found. Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: action_args: {'id': '451'} Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:02:31.160908 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:31.161880 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.163155 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7b06f6ae-d413-4df2-9823-620aa22529c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:02:31.164373 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7b06f6ae-d413-4df2-9823-620aa22529c0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.080837 Jun 21 03:02:31.164373 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jun 21 03:02:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 03:02:31.171388 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-66fce667-645c-4c16-aff5-98d1f5c7d656 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:31.185298 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-66fce667-645c-4c16-aff5-98d1f5c7d656 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017572 Jun 21 03:02:31.185842 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jun 21 03:02:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:02:31.196137 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:31.210546 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018027 Jun 21 03:02:31.211053 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jun 21 03:02:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:02:31.220522 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-24e79689-3e85-4c7f-b3b2-e1dc07988c0d admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:31.226040 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-24e79689-3e85-4c7f-b3b2-e1dc07988c0d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-24e79689-3e85-4c7f-b3b2-e1dc07988c0d admin admin] Request method failure captured: Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Accept: application/json Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Host: 10.222.0.16 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABisTTGfKG66n5duku8T8j2BV7N8fRT-6nLBLDvax0iqCeRVPs13MbFBfvs1SkJF3BekP8noejLAzKqbMgO1dj1VKfRYMHbKsg_25Fc9z58d6nt7UiRF2qXI-Nr3Ys-tgcy-csY4MaHj7ET7sznRnw922V_f4GXjiY_yDvHBuxxoQPdAN0 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Role: admin,member,reader Jun 21 03:02:31.227536 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Roles: admin,member,reader Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eab06a8b789343a7bc8eebc83d2a6637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eab06a8b789343a7bc8eebc83d2a6637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant-Id: eab06a8b789343a7bc8eebc83d2a6637 Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User: admin Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Id: b424d6dcd2eb40949197b229df3c84e2 Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: method: > Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: exception: Flavor 451 could not be found. Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: action_args: {'id': '451'} Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:02:31.229050 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:31.229859 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jun 21 03:02:31.231167 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-24e79689-3e85-4c7f-b3b2-e1dc07988c0d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:02:31.232396 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-24e79689-3e85-4c7f-b3b2-e1dc07988c0d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012056 Jun 21 03:02:31.232396 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jun 21 03:02:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 03:02:32.066201 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:32.067205 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 21 03:02:32.067594 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:32.261569 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d20781bc-d46e-44e1-b198-25bf5df1711d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:32.288173 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d20781bc-d46e-44e1-b198-25bf5df1711d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083920 Jun 21 03:02:32.288698 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jun 21 03:02:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:02:33.111950 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:33.113004 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 21 03:02:33.113396 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:33.306446 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-15c2f3d1-0f5d-4b89-8b1f-f433de4f7e4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:33.331087 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-15c2f3d1-0f5d-4b89-8b1f-f433de4f7e4f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.081116 Jun 21 03:02:33.331564 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jun 21 03:02:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:02:34.142592 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:34.143925 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jun 21 03:02:34.144319 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:34.344174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-47cada8e-d4d4-4206-9a3f-7dec27eeaddc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:34.364051 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-47cada8e-d4d4-4206-9a3f-7dec27eeaddc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075995 Jun 21 03:02:34.364534 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jun 21 03:02:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:02:35.195288 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:35.196290 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 21 03:02:35.196717 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:35.389226 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d9ba0fb1-f0ef-4b86-9ace-e6261895df61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:02:35.411538 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d9ba0fb1-f0ef-4b86-9ace-e6261895df61 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079813 Jun 21 03:02:35.412002 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jun 21 03:02:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:02:36.225518 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:36.226864 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Jun 21 03:02:36.227439 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:02:36.425872 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f664b421-8d1f-4347-ac7e-0e2e01155a9b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:02:36.445207 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f664b421-8d1f-4347-ac7e-0e2e01155a9b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084012 Jun 21 03:02:36.445742 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Tue Jun 21 03:02:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:03:23.139010 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:03:23.140007 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-3313ac88-57e0-4ec3-aa0e-3ffc656f206e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 21 03:03:23.140441 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jun 21 03:03:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:03:23.150881 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:03:23.203553 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9263f80a-837d-491c-b899-13c25cdb183c admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:03:23.222567 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-9263f80a-837d-491c-b899-13c25cdb183c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076226 Jun 21 03:03:23.223107 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jun 21 03:03:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:03:23.249501 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c3b59b74-7cf3-42e6-8400-328382fd07c0 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:03:23.253780 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_api:SELECT=14 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:03:23.259511 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-c3b59b74-7cf3-42e6-8400-328382fd07c0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016710 Jun 21 03:03:23.260024 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1282 bytes} [Tue Jun 21 03:03:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:03:23.272014 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-75f346d4-817e-46b9-9b44-727b08c91c67 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:03:23.280192 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-75f346d4-817e-46b9-9b44-727b08c91c67 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011787 Jun 21 03:03:23.280738 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1285 bytes} [Tue Jun 21 03:03:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:03:23.292524 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:03:23.300441 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011431 Jun 21 03:03:23.300968 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1285 bytes} [Tue Jun 21 03:03:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:03:23.312045 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-166a8dad-5d96-4bb5-8f6f-c6dd9d77b705 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:03:23.322691 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-166a8dad-5d96-4bb5-8f6f-c6dd9d77b705 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013673 Jun 21 03:03:23.323393 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1282 bytes} [Tue Jun 21 03:03:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:06:38.988365 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:38.989447 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jun 21 03:06:38.989848 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:06:39.131830 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=6 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:06:39.267823 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-1729b9cb-2625-43ac-96d4-2efb003ecddf admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:39.269666 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:06:39.269666 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jun 21 03:06:39.271403 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-1729b9cb-2625-43ac-96d4-2efb003ecddf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:39.271899 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-1729b9cb-2625-43ac-96d4-2efb003ecddf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:39.273092 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-1729b9cb-2625-43ac-96d4-2efb003ecddf admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:39.273692 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-1729b9cb-2625-43ac-96d4-2efb003ecddf admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:39.310672 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-1729b9cb-2625-43ac-96d4-2efb003ecddf admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.181381 Jun 21 03:06:39.311240 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jun 21 03:06:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:06:40.144232 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:40.145278 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 21 03:06:40.145648 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:06:40.348207 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d8a0fd9a-af8e-419a-82bd-d98e88efcced admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:40.350010 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:06:40.350010 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jun 21 03:06:40.351733 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d8a0fd9a-af8e-419a-82bd-d98e88efcced admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:40.352474 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d8a0fd9a-af8e-419a-82bd-d98e88efcced admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:40.353805 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d8a0fd9a-af8e-419a-82bd-d98e88efcced admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:40.354463 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d8a0fd9a-af8e-419a-82bd-d98e88efcced admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:40.375386 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d8a0fd9a-af8e-419a-82bd-d98e88efcced admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090256 Jun 21 03:06:40.376036 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jun 21 03:06:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:06:51.636888 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:51.637890 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 21 03:06:51.638290 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:06:51.782324 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:06:51.783146 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:06:51.783972 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=8 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:06:51.835535 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9f7bc8c6-0d3f-4497-b173-826d3d5edb81 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:51.836672 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:06:51.836672 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jun 21 03:06:51.837850 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-9f7bc8c6-0d3f-4497-b173-826d3d5edb81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:51.838292 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-9f7bc8c6-0d3f-4497-b173-826d3d5edb81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:51.839070 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-9f7bc8c6-0d3f-4497-b173-826d3d5edb81 admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:51.839496 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-9f7bc8c6-0d3f-4497-b173-826d3d5edb81 admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:51.864227 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-9f7bc8c6-0d3f-4497-b173-826d3d5edb81 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089284 Jun 21 03:06:51.864795 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jun 21 03:06:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:06:52.692457 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:52.693751 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2367fd7f-bb9f-4ef0-8a1b-5f26f453eb26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Jun 21 03:06:52.694311 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jun 21 03:06:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:06:52.917584 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a8ebe9a4-217f-4c0a-87c1-58ea9903f894 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:06:52.918748 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 03:06:52.918748 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jun 21 03:06:52.920174 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9a4-217f-4c0a-87c1-58ea9903f894 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:52.920816 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9a4-217f-4c0a-87c1-58ea9903f894 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:52.921956 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9a4-217f-4c0a-87c1-58ea9903f894 admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:06:52.922528 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9a4-217f-4c0a-87c1-58ea9903f894 admin admin] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:06:52.944103 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a8ebe9a4-217f-4c0a-87c1-58ea9903f894 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.102273 Jun 21 03:06:52.944680 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jun 21 03:06:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:07:48.426045 dv-cinder-846842-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 03:07:48.427001 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: Tue Jun 21 03:07:48 2022 - graceful shutdown triggered... Jun 21 03:07:48.427448 dv-cinder-846842-1-iscsi devstack@n-api.service[103271]: Gracefully killing worker 2 (pid: 103271)... Jun 21 03:07:48.427826 dv-cinder-846842-1-iscsi devstack@n-api.service[103270]: Gracefully killing worker 1 (pid: 103270)... Jun 21 03:07:49.428146 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: worker 1 buried after 1 seconds Jun 21 03:07:49.428146 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: worker 2 buried after 1 seconds Jun 21 03:07:49.428146 dv-cinder-846842-1-iscsi devstack@n-api.service[103269]: goodbye to uWSGI. Jun 21 03:07:49.430606 dv-cinder-846842-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 03:07:49.431508 dv-cinder-846842-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 03:07:49.435906 dv-cinder-846842-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 03:07:49.452455 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 03:07:49 2022] *** Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: nodename: dv-cinder-846842-1-iscsi Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: machine: x86_64 Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: clock source: unix Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: pcre jit disabled Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: detected number of CPU cores: 4 Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: current working directory: / Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: detected binary path: /usr/bin/uwsgi-core Jun 21 03:07:49.456153 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: your processes number limit is 47680 Jun 21 03:07:49.457766 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: your memory page size is 4096 bytes Jun 21 03:07:49.457766 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: detected max file descriptor number: 2048 Jun 21 03:07:49.457766 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: lock engine: pthread robust mutexes Jun 21 03:07:49.457766 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: thunder lock: enabled Jun 21 03:07:49.457766 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 03:07:49.457766 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 03:07:49.502086 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: Python main interpreter initialized at 0x55fb59d479c0 Jun 21 03:07:49.502086 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: python threads support enabled Jun 21 03:07:49.502086 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: your server socket listen backlog is limited to 100 connections Jun 21 03:07:49.502086 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: your mercy for graceful operations on workers is 90 seconds Jun 21 03:07:49.502532 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 03:07:49.502532 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: *** Operational MODE: preforking *** Jun 21 03:07:49.502800 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: *** uWSGI is running in multiple interpreter mode *** Jun 21 03:07:49.502800 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: spawned uWSGI master process (pid: 117643) Jun 21 03:07:49.503012 dv-cinder-846842-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 03:07:49.503637 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: spawned uWSGI worker 1 (pid: 117663, cores: 1) Jun 21 03:07:49.503910 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: spawned uWSGI worker 2 (pid: 117664, cores: 1) Jun 21 03:07:49.506651 dv-cinder-846842-1-iscsi devstack@n-api.service[117643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 03:07:50.161727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 03:07:50.181433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 03:07:51.359432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:07:51.359432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: from cryptography.utils import int_from_bytes Jun 21 03:07:51.360203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:07:51.360203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: from cryptography.utils import int_from_bytes Jun 21 03:07:51.365368 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:07:51.365368 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: from cryptography.utils import int_from_bytes Jun 21 03:07:51.365947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 03:07:51.365947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: from cryptography.utils import int_from_bytes Jun 21 03:07:53.698609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 03:07:53.699237 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 03:07:53.699528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 03:07:53.699753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 03:07:53.700003 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 03:07:53.700374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.700734 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.701084 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.701405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.701726 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.702028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.702317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.702632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.702966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.703212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.703525 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.703851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-1-iscsi {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.704192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.704517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.704829 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.705145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.705404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.705725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.706066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.706558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.708346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.708346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.708346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.708346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.708346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.708798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.709019 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.709252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.709596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.709879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.710335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-1-iscsi {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.710619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.710907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.711220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.711624 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.711941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.712237 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.712663 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.712999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.713313 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.713625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.713946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.714249 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.714561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.714868 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.715166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.715463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.715774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.716075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.716381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.716675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.716976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.717376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.717602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.717919 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.718167 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.718405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.718721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.719047 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.719335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.719635 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.719966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.720268 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.720597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.720901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.721199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.721467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.721810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.722117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.722402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.722721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.723344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.723683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.723843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.724189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.724573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.724908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.725273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.725508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.725837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.726126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.726428 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.726746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.727060 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.727386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.727687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.727912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.728220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.728543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.728868 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.729169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.729466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.729755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.730049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.730366 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.730663 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.730966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.731265 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.731561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.731848 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.732163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.732487 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.732772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.733106 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.733420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.733719 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.734017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.734303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.734601 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.735109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.735409 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.735706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.736028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.736330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.736642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.736959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.737277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.737578 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.737885 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.738185 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.738473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.739350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.739665 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.739973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.740277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.740609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.740993 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.741223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.741526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.741828 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.742133 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.742441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.742776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.743078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.743386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.743686 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.743999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.744333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.744674 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.745008 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.745322 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.745655 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.745979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.746292 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.746599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.746902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.747224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.747850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.748153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.748481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.749281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.749281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.749586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.749748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.750000 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.750328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.750630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.750956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.751259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.751579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.751886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.752223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.752589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.752904 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.753223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.753549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.753856 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.754162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.754544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.754866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.755188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.755494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.755809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.756118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.756473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.756756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.757060 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.757365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.757706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.758007 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.758321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.758628 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.758942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.759248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.759552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.759850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.760152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.760472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.760776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.761123 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.761383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.761706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.762024 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.762324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.762476 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 03:07:53.762940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.763028 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 03:07:53.763128 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.763219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 03:07:53.763317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.763539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.763633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 03:07:53.763796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 03:07:53.763899 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.764122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.764229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.764462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.764573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.764758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.764864 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.765062 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.765167 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.765381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.765502 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.765687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.765814 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.765988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.766094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.766304 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.766402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.766607 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.766717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.766867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.767019 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.767211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.767520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.767797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.767915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.768119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.768219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-1-iscsi {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.768448 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.768612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.768756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.768922 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.769067 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.769216 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.769359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.769499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.769655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.769798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.770021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.770178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.770329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.770496 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.770732 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.770891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.771064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.771204 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.771353 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.771509 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.771661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.771812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.771979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.772127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.772290 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.772481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.772637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.772799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.772953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.773095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.773243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.773398 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.773548 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.773689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.773831 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.773971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.774122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.774290 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-1-iscsi {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.774434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.774575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.774726 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.774940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.775098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.775242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.775389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.775616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.775771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.775997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.776142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.776283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.776466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.776614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.776820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.777004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.777318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.777793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.777942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.778093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.778235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.778386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.778530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.778682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.778833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.778983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.779140 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.779306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.779449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.779589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.779730 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.779871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.780021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.780165 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.780306 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.780466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.780656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.780818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.781044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.781196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.781357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.781514 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.781657 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.781806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.781948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.782102 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.782254 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.782397 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.782397 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.782679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.782820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.782982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.783134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.783319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.783473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.783626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.783789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.783933 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.784082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.787576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.788022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.788185 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.788349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.788550 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.788809 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.788967 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.789119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.789270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.789423 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.789575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.789728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.789871 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.790013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.790169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.790320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.790478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.790631 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.790631 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.790922 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.791213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.791378 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.791522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.791673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.791824 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.791975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.792164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.792309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.792468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.792626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.792782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.792931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.793087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.793230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.793378 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.793529 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.793680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.793680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.793962 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.794113 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.794262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.794405 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.794554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.794722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.794866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.795016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.795165 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.795307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.795456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.795618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.795769 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.795920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.796063 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.796204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.796353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.796586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.796771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.797055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.797198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.797358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.797646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.797803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.798187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.798337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.798478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.798629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.798803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.799031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.799177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.799330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.799471 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.799682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.799850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.799999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.800140 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.800289 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.800457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.800615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.800772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.800916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.801066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.801420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.801592 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.801744 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.801967 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.802127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.802277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.802428 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.802570 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.802727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.802878 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.803029 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.803181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.803333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.803495 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.803636 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.803777 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.803918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.804073 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.804218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.804368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.804564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.804719 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.804870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.805025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.805168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.805310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.805472 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.805615 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.805763 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.805913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.806055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.806196 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.806349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.806502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.806655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.806878 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.807183 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.807341 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.807490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.807794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.807958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.808345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.808539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.808703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.808847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.808989 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.809248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.809248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.809532 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.809683 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.809826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.809977 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.810139 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.810292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.810435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.810587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.810737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.810888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.810993 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.811085 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.811176 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.811262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.811356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.811520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.811618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.811702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.811702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 03:07:53.811878 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.811964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812144 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812227 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812227 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812772 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.812917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.813928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814827 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.814989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815132 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.815460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.816154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.816297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.816474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.816638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.816638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.817100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.817463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.817612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.817915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.818075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.818475 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.818628 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.818771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.818914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.819057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.819229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.819461 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.819620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.819762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.819762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820032 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820342 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.820998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.821141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.821283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.821425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.821587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.821729 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.821880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822175 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.822626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.823191 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.823344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.823494 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.823645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.823799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.823942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.824085 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.824235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.824392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.824570 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.824714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.824864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825319 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.825880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826469 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.826928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.827078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.827238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.827712 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.828013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.828166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.828322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.828706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.828866 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.829012 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.829163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.829305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.829481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.829716 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.829865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830763 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.830914 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831208 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831664 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.831807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.832103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.832255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.832584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.832754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.832899 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833499 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.833939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.834094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.834245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.834396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.834546 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.834691 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.834833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.835964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.836107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.836257 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.836399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.836584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.836747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.836898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.837040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.837188 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.837340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.837490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.837787 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.837937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.838230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.838386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.838545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.838912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839224 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.839707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.840241 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.840399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.840605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.840754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.840968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.841122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.841269 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.841425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.841574 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.841722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.841880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.842038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.842195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.842345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.842504 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.842653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.842896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.843063 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.843224 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.843381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.843538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.843697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.843847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844302 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.844992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845290 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.845895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.846199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.846357 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.846506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.846664 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.846822 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.846971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.847126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.847126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.847470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.847629 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.847924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.848325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.848543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.848717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.849108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.849274 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.849450 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.849599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.849755 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.849942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.850185 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.850350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.850499 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.850655 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.850816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.850985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.851187 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.851348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.851502 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.851670 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.851830 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.851980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.852128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.852276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.852450 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.852605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.852771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.852929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.853999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.854146 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.854303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.854460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.854624 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.854774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.854931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.855080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.855229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.855433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.855638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.855801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.855958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856108 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856301 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856515 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856830 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856830 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.856830 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.857262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.857426 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.857585 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.857746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.858038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.858201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.858498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.858663 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.858815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.858980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.859392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.859551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.859716 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.859876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.860035 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.860210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.860210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.860633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.860796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.860947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.861112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.861276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.862117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.862284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.862444 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.862603 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.862767 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.862931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.863082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.863473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.863693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.863859 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.864958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.865125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.865283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.865441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.865591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.865739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.865898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866512 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866671 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866830 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.866986 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.867164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.867330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.867489 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.867653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.867813 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.868145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.868313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.868633 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.868803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.868970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.869140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.869552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.869713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.869882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.870032 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.870195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.870356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.870626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.870782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.870938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.871099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.871256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.871415 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.871565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.871713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.871861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.872036 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.872187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.872788 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.872942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.873099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.873255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.873417 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.873574 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.873724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.873880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.874030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.874178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.874352 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.874503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.874653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875215 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.875700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.876116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.876455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.876615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.876788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877124 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877674 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.877994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878352 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878566 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.878966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879157 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879444 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879852 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.879947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880301 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880742 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.880927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881199 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881290 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881561 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.881916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882006 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882371 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882550 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882634 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.882987 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883155 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883691 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883782 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.883965 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884326 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884871 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.884967 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885053 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885144 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885312 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.885938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886101 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886271 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.886983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887076 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887342 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887426 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887784 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887874 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.887958 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888041 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888223 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.888921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889188 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889371 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889720 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.889969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890053 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890582 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.890926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891176 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891355 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891615 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891700 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891790 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.891984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892159 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892532 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892809 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.892900 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893005 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.893966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894132 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894414 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894507 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894598 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894691 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.894879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.895051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.895371 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.895625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.895884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.895990 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.896194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.896299 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.896545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.896643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.896867 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.896971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.897177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.897301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.897486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.897595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.897795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.897894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.898104 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.898201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.898446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.898566 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.898754 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.898853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.899061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.899141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.899363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.899457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.899670 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.899989 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.900500 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.900865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.901185 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.901556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.901872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.902197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.902445 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.902626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.902861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.903015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.903236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.903569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.904121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.904309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.904595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.904698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.904823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.905012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.905158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.905348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.905492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.905675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.905817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906132 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906780 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.906979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.907287 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.907411 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.907606 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.907724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.907923 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.908038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.908232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.908363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.908562 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.908708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.908899 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909005 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909296 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909596 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.909934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.910126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.910277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.910447 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.910614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.910800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.911102 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.911332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.911507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.911662 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.911826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.911986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.912137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.912375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.912500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.912726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.912833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913138 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.913968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914068 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914268 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.914979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.915189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.915289 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.915498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.915595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.915844 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.915961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.916145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.916236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.916476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.916621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.916796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.916947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.917103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.917239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.917454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.917547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.917768 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.917868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.918078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.918170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.918425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.918516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.918741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.918841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.919112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.919275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.919470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.919608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.919790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.919935 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.920105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.920248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.920433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.920612 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.920751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.920917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.921062 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.921221 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.921377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.921525 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.921705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.921857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922168 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922634 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922786 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.922958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.923096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.923264 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.923405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.923590 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.923713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924654 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924748 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.924962 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.925090 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.925269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.925407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.925576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.925720 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.925881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.926048 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.926384 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.926812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.926987 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.927136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.927326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.927466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.927638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.927764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.927959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.928080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.928276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.928392 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.928644 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.928739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.928973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.929067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.929289 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.929392 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.929609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.929701 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.929918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.930043 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.930231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.930329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.930538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.930668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.930865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.931055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.931190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.931368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.931614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.931721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.931939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.932038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.932255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.932359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.932630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.932722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.932953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.933979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.934189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.934288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.934498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.934589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.934823 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.934921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.935133 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.935225 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.935444 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.935570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.935746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.935851 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936787 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.936988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937381 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937691 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937895 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.937986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.938194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.938292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.938494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.938612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.938796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.938889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939468 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939698 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.939997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.940125 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.940296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.940395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.940620 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.940713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.940930 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.941033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.941219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.941320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.941526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.941628 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.941874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.942143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.942242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.942464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.942765 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.942853 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.943063 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.943166 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.943389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.943487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.943717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.943807 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.944031 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.944135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.944349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.944461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.944683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.944775 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945308 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.945927 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.946946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.947154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.947259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.947460 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.947770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.947871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.948080 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.948170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.948388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.948510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.948721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.948825 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949027 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.949948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.950056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.950273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.950369 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.950587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.950697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.950902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951645 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.951944 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.952156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.952251 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.952500 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.952642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.952821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.952928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.953127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.953232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.953432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.953525 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.953745 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.953838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954162 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.954988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.955086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.955303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.955394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.955624 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.955713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.955963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.956181 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.956273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.956534 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.956629 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.956855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.956956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.957170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.957263 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.957606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.957714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.957912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.958069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.958169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 03:07:53.958391 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.958708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.959025 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.959341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.959661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.959992 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.960317 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.960669 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.961008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.961332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.961651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.970964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.971326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.971716 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.972056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.972380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.972749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.973108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.973432 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.973759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.974084 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.974410 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.974734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.975057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.975427 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.975702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.976025 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.976356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.976725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.977057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.977378 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.977883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.978218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.978755 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.979083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.979422 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.979754 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.980253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.980656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.981050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.981431 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.981776 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.982111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.982439 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.982765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.983083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.983419 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.983741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.984056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.984384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.984736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.985294 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.985652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.985976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.986310 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.986641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.986964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.987278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.987610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.987924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.988239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.988652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.989074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.989499 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.989816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.990145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.990462 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.990779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.991094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.991404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.991734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.992046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.992356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.992695 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.993011 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.993320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.993629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.993939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.994248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.994563 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.994870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.995182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.995521 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.995830 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.996140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.996447 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.996832 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.997157 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.997796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.998102 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.998422 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.998735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.999061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.999363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:53.999676 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.000021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.000343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.000912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.001330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.001586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.001925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.002263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.002576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.002888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.003199 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.003530 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.003847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.004164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.004755 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.005162 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.005487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.005805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.006123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.006441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.006757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.007071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.007385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.007704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.008020 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.008338 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.008710 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.009036 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.009356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.009673 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.009997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.010329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.010621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.010933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.011243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.011563 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.011893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.012210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.012540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.013066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.013385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.013709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.014033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.014344 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.014670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.014998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.015311 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.015636 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.015950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.016283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.016652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.017009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.017309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.017617 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.017921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.018225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.018535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.018855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.019163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.019468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.019673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO dbcounter [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Registered counter for database nova_api Jun 21 03:07:54.019900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.020243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.020673 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.020986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.021295 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.021638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.021948 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.022249 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.022579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.022863 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.023166 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.023469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.023774 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.024086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.024391 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.024707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.025012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.025312 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.025618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.025948 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.026280 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.026602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.026920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.027229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.027548 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.027862 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.028168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.028517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.028834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.029147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.029480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.029790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.030111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.030425 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.030829 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.031057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.031372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.031701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.032025 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.032332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.032683 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.033001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.033320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.033635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.033947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.034273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.034684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.034989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.035310 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.035684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.035998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.036315 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.036659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.036990 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.037332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.037618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.037946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.038273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.038622 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.038936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.039280 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.039627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.039931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.040245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.040573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 03:07:54.040818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 03:07:54.040946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_db.sqlalchemy.engines [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.047318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writer thread running {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.102895 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.context [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4968fc3d-d05a-41d1-aa8d-490f1ec89c5c(cell1) {{(pid=117663) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 03:07:54.103573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Registered counter for database nova_api Jun 21 03:07:54.107024 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:07:54.108606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:07:54.109399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:07:54.111325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:07:54.113338 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO dbcounter [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Registered counter for database nova_cell0 Jun 21 03:07:54.117385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO dbcounter [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Registered counter for database nova_cell1 Jun 21 03:07:54.124586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.127380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_db.sqlalchemy.engines [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.128149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_db.sqlalchemy.engines [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.131804 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.135223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writer thread running {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.137276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writer thread running {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.188549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.context [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4968fc3d-d05a-41d1-aa8d-490f1ec89c5c(cell1) {{(pid=117664) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 03:07:54.193182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:07:54.194785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:07:54.195586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:07:54.197581 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:07:54.199574 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Registered counter for database nova_cell0 Jun 21 03:07:54.203638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Registered counter for database nova_cell1 Jun 21 03:07:54.211075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.213158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.219936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.222016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.282259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO dbcounter [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Registered counter for database nova_cell0 Jun 21 03:07:54.290046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_db.sqlalchemy.engines [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.294927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writer thread running {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.369341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Registered counter for database nova_cell0 Jun 21 03:07:54.378745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 03:07:54.384317 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 03:07:54.607250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: WARNING keystonemiddleware.auth_token [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:07:54.614737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: WARNING keystonemiddleware.auth_token [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:07:54.698152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:07:54.705533 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:07:54.953224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: WARNING keystonemiddleware.auth_token [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:07:54.959500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: WARNING keystonemiddleware.auth_token [None req-9482aee2-a12e-4dd9-ab8b-57f480b6c029 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:07:54.964900 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fb59d479c0 pid: 117663 (default app) Jun 21 03:07:55.043827 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 03:07:55.049872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-12069bb1-ecc4-4aa4-b201-93b23fad301e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 03:07:55.055346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb59d479c0 pid: 117664 (default app) Jun 21 03:08:39.540919 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:39.541864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:39.543136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:39.544189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:39.939845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3eb2b148-d6ef-4613-aaec-0a36103ef376 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c1dd1f0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:40.678627 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3eb2b148-d6ef-4613-aaec-0a36103ef376 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f688bc4c-41fc-499b-b0a8-4f03af32031a" status: 200 len: 351 microversion: 2.1 time: 1.144246 Jun 21 03:08:40.686715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:08:39 2022] GET /compute/v2.1/os-volumes/f688bc4c-41fc-499b-b0a8-4f03af32031a => generated 351 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:42.970960 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-75c7130b-2d94-49d8-89f7-6af6020b6bee tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c246280>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:43.045911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:43.046726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:43.052801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:43.054088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:08:43.699663 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-75c7130b-2d94-49d8-89f7-6af6020b6bee tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/439eee9a-cba1-47a6-8d2b-49e0a4a748f2" status: 200 len: 351 microversion: 2.1 time: 1.136965 Jun 21 03:08:43.701936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:08:42 2022] GET /compute/v2.1/os-volumes/439eee9a-cba1-47a6-8d2b-49e0a4a748f2 => generated 351 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:45.555918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-833ab813-8d77-4df4-a339-c5036f7047c2 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c0a5550>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:45.751483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-833ab813-8d77-4df4-a339-c5036f7047c2 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/80de1eae-8910-486f-9574-f5a3a0936578" status: 200 len: 350 microversion: 2.1 time: 0.199723 Jun 21 03:08:45.752133 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:08:45 2022] GET /compute/v2.1/os-volumes/80de1eae-8910-486f-9574-f5a3a0936578 => generated 350 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:45.764797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-79dbb98a-c121-4ca1-a8ad-452326b817dd tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c09a4c0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:45.998831 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-79dbb98a-c121-4ca1-a8ad-452326b817dd tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.238000 Jun 21 03:08:46.008087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1133 bytes} [Tue Jun 21 03:08:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:46.013188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9f3b7ab7-b3cc-49cc-a977-a7d5ad020382 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c0a5c10>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:46.187345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9f3b7ab7-b3cc-49cc-a977-a7d5ad020382 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.177082 Jun 21 03:08:46.196038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1148 bytes} [Tue Jun 21 03:08:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:46.203012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e7a2ec7f-8189-4f08-aa16-ed4cc74c48e3 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c09ad30>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:46.424501 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e7a2ec7f-8189-4f08-aa16-ed4cc74c48e3 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226813 Jun 21 03:08:46.425228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1133 bytes} [Tue Jun 21 03:08:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:46.436943 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1d97b756-cb22-4842-908b-b252b8e21cab tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c0a5d30>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:46.656755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1d97b756-cb22-4842-908b-b252b8e21cab tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.220735 Jun 21 03:08:46.664637 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1166 bytes} [Tue Jun 21 03:08:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:46.672181 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8f57b943-5ae7-41aa-8a16-64f16497c6a4 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c05c9d0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:46.893466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8f57b943-5ae7-41aa-8a16-64f16497c6a4 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.227382 Jun 21 03:08:46.895210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1169 bytes} [Tue Jun 21 03:08:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:46.906990 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f7e31d37-30cc-4948-8e66-8c3d9f8a6e15 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c066160>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:47.096123 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f7e31d37-30cc-4948-8e66-8c3d9f8a6e15 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.192751 Jun 21 03:08:47.096862 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1154 bytes} [Tue Jun 21 03:08:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:47.107845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a5b4795d-8703-47e0-94f1-c695112f8a57 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c066dc0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:47.321936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a5b4795d-8703-47e0-94f1-c695112f8a57 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.217692 Jun 21 03:08:47.322503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1187 bytes} [Tue Jun 21 03:08:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:08:47.335011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5b667a47-43fd-4e48-8689-db655e5494c6 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] Calling method '.version_select at 0x7fe79c0663a0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:47.360978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-563295ee-9424-4f8b-a6b6-766bb22e1a89 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: .version_select at 0x7fe79c05c790>, body: {"keypair": {"name": "tempest-keypair-71903141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEAsM+K/JjOEL7eoukxP43DqPxBGv+Cyq1YX6vQm0+7hOLmriNPL1WiM1fURqjuKqeU/vYVErV3Rhk8PIueuRcbp9MR3eBKbWFKMBV7SRsYaOxqyS8oXj+w1PBlIJ0Aag=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:47.557875 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-563295ee-9424-4f8b-a6b6-766bb22e1a89 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:08:47.594240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-563295ee-9424-4f8b-a6b6-766bb22e1a89 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:08:47.662400 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5b667a47-43fd-4e48-8689-db655e5494c6 tempest-VolumesTestJSON-1897075827 tempest-VolumesTestJSON-1897075827-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.331241 Jun 21 03:08:47.663027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1154 bytes} [Tue Jun 21 03:08:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:47.765189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-563295ee-9424-4f8b-a6b6-766bb22e1a89 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.721835 Jun 21 03:08:47.766652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 5/12] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:08:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:51.394058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ab5c8ab4-5ac4-46d8-8928-0e8bbc16563b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: .version_select at 0x7fe79c0a5ca0>, body: {"keypair": {"name": "tempest-keypair-1614271192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8azBTyOHVyDRIMWBFPEe8jdeyJ7GGyzOxDoVtOr9f4gD4ZASl89ZqLumtz8lCYMkWaBY2MXxYTbvpb1rC7WH9D/l1gXY6mAll3x3ZqmEAEG2n5Vya2zmZctEe6/R41hw=="}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:51.618340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-ab5c8ab4-5ac4-46d8-8928-0e8bbc16563b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for project 8dd05fc495454e9290c277ed4db003d8. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:08:51.639037 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-ab5c8ab4-5ac4-46d8-8928-0e8bbc16563b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for user 937fff3ec09e4f8a9a9a5fcdf2027a2b and project 8dd05fc495454e9290c277ed4db003d8. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:08:51.776924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ab5c8ab4-5ac4-46d8-8928-0e8bbc16563b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.566700 Jun 21 03:08:51.777873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 8/13] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:08:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:08:53.233849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-849869371", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "networks": [{"uuid": "2ebbaafd-3967-48e9-87c6-06018a4be59f"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:53.479652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] validate_networks() for [('2ebbaafd-3967-48e9-87c6-06018a4be59f', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:08:53.866455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-179053815", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:54.053330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] validate_networks() for [('09798fdc-1a5e-44af-acf8-2181549f3c85', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:08:55.351183 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:08:55.351684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:08:55.352122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:08:55.353171 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:08:55.353739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:08:55.383967 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:55.384739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:55.385802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:55.386374 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:55.551914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Getting quotas for project 8c102f5ee47e426c8f4e0ced15f60bee. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:08:55.575950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Getting quotas for user e3ae9f551626460e864561c613d5f273 and project 8c102f5ee47e426c8f4e0ced15f60bee. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:08:55.602377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:08:55.616377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:08:55.857026 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-641441b7-ac7b-4558-85e3-846fedec7494 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.839593 Jun 21 03:08:55.861445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 6/14] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:08:55.890915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1ab2bb66-9247-4028-8833-c321884de042 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:55.894186 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1ab2bb66-9247-4028-8833-c321884de042 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:08:56.085541 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1ab2bb66-9247-4028-8833-c321884de042 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:08:56.132999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1ab2bb66-9247-4028-8833-c321884de042 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1214 microversion: 2.1 time: 0.266831 Jun 21 03:08:56.141571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:08:55 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:56.154867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-119720516", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c23877e-0103-47a1-a2d4-5b0d47022cc2"}], "security_groups": [{"name": "tempest-securitygroup--566739900"}], "key_name": "tempest-keypair-71903141", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:56.396728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] validate_networks() for [('4c23877e-0103-47a1-a2d4-5b0d47022cc2', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:08:57.304842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:08:57.305616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:08:57.306291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:08:57.306886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:08:57.307500 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:08:57.339732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:57.340481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:57.345885 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:57.349983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:57.412605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:08:57.431617 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:08:57.483168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:08:57.492238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:08:57.649974 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-183d70d3-6608-4fdf-bede-86acfbc21955 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.505149 Jun 21 03:08:57.653223 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:08:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:08:57.711229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:08:57.711758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:08:57.712101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:08:57.713073 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:08:57.713640 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:08:57.730696 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:57.732543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:57.737394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:57.738096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:57.866023 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:08:57.884404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for user 8bd2fc9f3216425cbcbbed84b7815529 and project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:08:57.925776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:08:57.928607 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:08:58.158169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-12b88f66-687a-4cd6-b899-1ce5023206f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'create', calling method: .version_select at 0x7fe79a6c0d30>, body: {"keypair": {"name": "tempest-keypair-1491865930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYhMoCsgioNbAfMfCsF22PEBQpcvu7I64TvgBpcmPK+gYYDhJVPi+40mETweQ46LAy9Q8NNvNbyoSG7emxwlQKEWody9ACZpMpOFGE0byhUwnSmg0PN/8s6AReW07/spQ=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:58.213061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-12b88f66-687a-4cd6-b899-1ce5023206f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:08:58.213899 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8959b08f-883d-476f-b393-cf2f35dad6e3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.468050 Jun 21 03:08:58.220709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 9/17] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:08:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 4476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 03:08:58.224644 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-12b88f66-687a-4cd6-b899-1ce5023206f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for user b778c9e1d53c44edb54b0c94c458e20c and project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:08:58.227311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8e8b1533-7326-4e7d-8129-f91184f791a3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:58.227918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8e8b1533-7326-4e7d-8129-f91184f791a3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:08:58.299096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-12b88f66-687a-4cd6-b899-1ce5023206f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.642877 Jun 21 03:08:58.302016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 9/18] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Jun 21 03:08:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 647 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 03:08:58.334724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-02972732-3a11-4e7f-aef6-55355062833f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:58.345647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-02972732-3a11-4e7f-aef6-55355062833f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:08:58.583807 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-02972732-3a11-4e7f-aef6-55355062833f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:08:58.600907 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-02972732-3a11-4e7f-aef6-55355062833f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1239 microversion: 2.1 time: 0.292164 Jun 21 03:08:58.606629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 10/19] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:08:58 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1239 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:58.632262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d4d424c5-84e2-4a75-8379-28f2d00c1ea1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:58.632909 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d4d424c5-84e2-4a75-8379-28f2d00c1ea1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:08:58.867628 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d4d424c5-84e2-4a75-8379-28f2d00c1ea1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:08:58.880455 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d4d424c5-84e2-4a75-8379-28f2d00c1ea1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1221 microversion: 2.1 time: 0.271718 Jun 21 03:08:58.885221 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 11/20] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:08:58 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:59.019101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8e8b1533-7326-4e7d-8129-f91184f791a3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:08:59.051442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8e8b1533-7326-4e7d-8129-f91184f791a3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1214 microversion: 2.1 time: 0.829177 Jun 21 03:08:59.053493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 10/21] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:08:58 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1214 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:08:59.220985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-387455", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:08:59.384905 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] validate_networks() for [('09798fdc-1a5e-44af-acf8-2181549f3c85', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:08:59.623230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:08:59.624256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:08:59.643184 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:59.643735 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:08:59.646533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:08:59.646974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:00.057222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:00.080817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6ea84c8e-8a65-43c1-8dab-b00e570e8131 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1235 microversion: 2.1 time: 0.461180 Jun 21 03:09:00.086907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 11/22] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:08:59 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1235 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:00.099629 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:00.109334 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:00.144602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:00.151095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:00.154687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:00.156542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:00.327641 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:00.344316 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-28c80adc-a403-4b47-8d41-cb55387a41c7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1266 microversion: 2.1 time: 0.253495 Jun 21 03:09:00.345530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:00 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:00.359836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1795172530", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bfb184d-dbe2-40fa-876c-bcaf1f55ee1e"}], "security_groups": [{"name": "tempest-securitygroup--1869540100"}], "key_name": "tempest-keypair-1614271192", "user_data": "}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:00.577921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] validate_networks() for [('4bfb184d-dbe2-40fa-876c-bcaf1f55ee1e', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:09:01.024018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:09:01.025482 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:09:01.026273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:09:01.027133 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:09:01.027696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:09:01.040859 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.041917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.042994 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.046686 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.079244 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:09:01.088151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for user 8bd2fc9f3216425cbcbbed84b7815529 and project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:09:01.114090 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:09:01.116783 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:09:01.221523 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ea89b437-096e-4065-84d1-b672f220eb3c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.007589 Jun 21 03:09:01.222182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 12/24] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:08:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:09:01.233914 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:09:01.235168 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:09:01.236312 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:09:01.236668 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:09:01.237137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:09:01.246893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:01.249725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:01.264775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.265231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.266037 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.266142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.266476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.266593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.267800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.268351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.292773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for project 8dd05fc495454e9290c277ed4db003d8. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:09:01.297840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for user 937fff3ec09e4f8a9a9a5fcdf2027a2b and project 8dd05fc495454e9290c277ed4db003d8. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:09:01.328686 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:09:01.334643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:09:01.467631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fa43edb9-804f-4d0b-adf7-2a91bb250ba6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.119586 Jun 21 03:09:01.468285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 13/25] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:09:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:09:01.490262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a29fdb70-6608-4694-aff0-ce8fa87c032d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:01.506692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a29fdb70-6608-4694-aff0-ce8fa87c032d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:01.673901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a29fdb70-6608-4694-aff0-ce8fa87c032d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:01.685025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a29fdb70-6608-4694-aff0-ce8fa87c032d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1218 microversion: 2.1 time: 0.209908 Jun 21 03:09:01.686107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:01.690473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:01 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:01.703290 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1918e684-5065-42c9-8f7a-63d11d203e6c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1235 microversion: 2.1 time: 0.473895 Jun 21 03:09:01.715894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:01.716001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:01 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1235 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:01.716094 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:01.729030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-738574f7-1ab1-42be-9840-e55dee9e4cf8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:01.730726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-738574f7-1ab1-42be-9840-e55dee9e4cf8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:01.736838 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.737433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.738246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:01.738687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:01.859538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-738574f7-1ab1-42be-9840-e55dee9e4cf8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:01.879880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-738574f7-1ab1-42be-9840-e55dee9e4cf8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1238 microversion: 2.1 time: 0.163985 Jun 21 03:09:01.881082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:01 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1238 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:02.019361 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:02.033985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-99038cfe-2ecb-45aa-9c11-9707f7c9fbd7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1266 microversion: 2.1 time: 0.338654 Jun 21 03:09:02.035642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:01 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:02.480948 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1504606528", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcb1b71f-0c69-4277-b872-e57779bda511"}], "security_groups": [{"name": "tempest-securitygroup--953895980"}], "key_name": "tempest-keypair-1491865930", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:02.646066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] validate_networks() for [('dcb1b71f-0c69-4277-b872-e57779bda511', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:09:02.707912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:02.709234 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:02.715880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:02.716602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:02.717506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:02.718156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.026931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.035058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-158802ad-bf9c-4f1f-95da-348f69794053 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1222 microversion: 2.1 time: 0.331609 Jun 21 03:09:03.038314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:02 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:03.041626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:03.042232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:03.056755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.057198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.058195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.058823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.139056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.148478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d2eb5852-e358-4bc7-9a1c-8d95809a36bb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1235 microversion: 2.1 time: 0.110760 Jun 21 03:09:03.149161 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:03 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:03.157612 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:03.158427 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:03.167901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.168360 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.169315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.170084 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.278849 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.293542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3549c0c9-acfc-46da-910d-085780e86c16 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1242 microversion: 2.1 time: 0.138839 Jun 21 03:09:03.294130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:03 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:03.315004 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:03.320779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:03.322744 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:09:03.323192 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:09:03.323805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:09:03.324075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:09:03.324516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:09:03.328399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.328882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.329646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.330080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.339298 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.339986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.340829 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:03.341260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:03.375914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:03.387250 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:09:03.399489 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for user b778c9e1d53c44edb54b0c94c458e20c and project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:09:03.433612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:09:03.439479 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:09:03.493813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.506725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-57364452-4b3b-4619-a8d8-367a9683929e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1266 microversion: 2.1 time: 0.211301 Jun 21 03:09:03.516462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 19/33] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:03 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:03.559203 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-35d0a6e4-f37e-4dd4-9b4e-a4d84f7f9ba3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.082649 Jun 21 03:09:03.562692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 15/34] 10.222.0.16 () {62 vars in 1187 bytes} [Tue Jun 21 03:09:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 03:09:03.576746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-51b7bafe-38ee-4280-ba0d-c6da560bf500 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:03.583170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-51b7bafe-38ee-4280-ba0d-c6da560bf500 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:03.759644 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-51b7bafe-38ee-4280-ba0d-c6da560bf500 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.769590 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-51b7bafe-38ee-4280-ba0d-c6da560bf500 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.775269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-51b7bafe-38ee-4280-ba0d-c6da560bf500 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:03.776464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-51b7bafe-38ee-4280-ba0d-c6da560bf500 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1282 microversion: 2.20 time: 0.203788 Jun 21 03:09:03.779298 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 20/35] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:03 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:04.052348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:04.052999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:04.070553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.071089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.071935 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.072382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.173715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:04.174649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:04.182929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.184444 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.186197 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.189844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.305409 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:04.314625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2eb173a6-0e3f-4643-974d-7dd8dfc6ffba tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1270 microversion: 2.1 time: 0.267039 Jun 21 03:09:04.319677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 16/36] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:04 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:04.330865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:04.333222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:04.342821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.343444 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.344480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.346881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.454392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:04.469922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7c82484f-1073-4a94-93cd-c37946eab00c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1290 microversion: 2.1 time: 0.148503 Jun 21 03:09:04.471618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:04 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1290 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:04.531657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:04.532436 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:04.546506 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.546992 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.548345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.549075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.633570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:04.642986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-091c632a-d42e-40ec-879b-f0566e0701ca tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1274 microversion: 2.1 time: 0.115533 Jun 21 03:09:04.644980 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:04 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:04.796248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:04.796943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:04.816387 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.825480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.827534 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:04.829426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:04.834095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:04.842917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9d3ec0cd-8f61-4e93-a05f-0d79d8a2abe2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1291 microversion: 2.1 time: 0.674857 Jun 21 03:09:04.846696 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:04 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1291 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:05.057309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:05.075918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:05.078120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:05.082688 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-73ad61c5-c186-4cc0-82a4-3869c2e16b2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1286 microversion: 2.20 time: 0.290529 Jun 21 03:09:05.084832 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:04 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1286 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:05.335398 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:05.336812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:05.353160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:05.353736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:05.354586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:05.355018 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:05.490738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:05.494638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:05.499015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:05.513241 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d57b6f03-c865-486c-8b41-74a32ce06c7e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1270 microversion: 2.1 time: 0.182658 Jun 21 03:09:05.535446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:05.536151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:05 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:05.537085 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:05.539451 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:05.540616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:05.661602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:05.662794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:05.678901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:05.679623 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:05.683455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:05.689674 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:05.962077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:05.970084 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d5ed892b-a8f3-4129-b272-8a10df4d684c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1298 microversion: 2.1 time: 0.485493 Jun 21 03:09:05.986806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 20/42] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:05 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1298 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:05.992882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:06.000973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:06.009327 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:06.016611 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:06.017068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:06.017847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6c7e143c-15bd-41dd-9dd8-83dad4bf2607 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1284 microversion: 2.1 time: 0.360478 Jun 21 03:09:06.018745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:06.019366 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:06.024293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:05 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1284 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:06.103240 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:06.103844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:06.112993 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:06.115374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:06.120012 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:06.120552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:06.272023 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:06.283399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:06.285096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:06.289893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f3746f17-2d0d-4a5c-9e8b-4d353052e7c8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1334 microversion: 2.20 time: 0.190532 Jun 21 03:09:06.290477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 24/44] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:06 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:06.534931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:06.535788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:06.545344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:06.546020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:06.546931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:06.553226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:06.664449 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:06.678857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c2402d20-c096-4322-b972-7295586e1e23 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1309 microversion: 2.1 time: 0.688542 Jun 21 03:09:06.681384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 21/45] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:05 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1309 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:06.816512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:06.831352 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-768044a6-3fd1-40a7-b282-20213aca9f86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1276 microversion: 2.1 time: 0.300086 Jun 21 03:09:06.832594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 25/46] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:06 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:07.005379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:07.007351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:07.017412 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.018253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.019482 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.020241 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.040405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:07.041678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:07.055261 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.056041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.057035 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.060743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.246689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:07.258623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-51f93c00-9214-4201-996c-d84d2da858ca tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1296 microversion: 2.1 time: 0.267254 Jun 21 03:09:07.259209 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 22/47] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:06 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1296 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:07.293664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:07.310419 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:07.311025 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:07.314777 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e42b26d9-0b2b-4eba-8158-fe156c64ac47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1272 microversion: 2.1 time: 0.278446 Jun 21 03:09:07.317253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:07 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:07.322151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.322802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.323713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.324287 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.603649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:07.613172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:07.626424 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:07.627852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-656acd69-8cb5-4272-8cd8-faa3deea3566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.321261 Jun 21 03:09:07.628856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 23/49] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:07 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:07.699953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:07.702483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:07.718090 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.718788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.721815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.722499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.854142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:07.854833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:07.862000 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.862729 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.864053 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:07.864656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:07.965174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:07.978963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-15945c44-5ba2-448f-a469-3f5beb3d6007 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1297 microversion: 2.1 time: 0.283764 Jun 21 03:09:07.979558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 27/50] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:07 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1297 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:08.118118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:08.130986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-87925a96-62fb-43b6-bcb3-80aea09a488a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1276 microversion: 2.1 time: 0.280535 Jun 21 03:09:08.142026 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 24/51] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:07 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:08.277108 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:08.277573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:08.288949 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:08.289399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:08.290366 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:08.290808 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:08.337800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:08.338407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:08.347793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:08.348253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:08.349045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:08.349468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:08.465757 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:08.476254 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0c253e01-02ab-4671-980c-894218ad1fa2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1296 microversion: 2.1 time: 0.202707 Jun 21 03:09:08.477917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 28/52] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:08 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1296 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:08.573826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:08.582982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1f13fafe-7607-4740-bc39-bf85b05107d6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1272 microversion: 2.1 time: 0.252165 Jun 21 03:09:08.584257 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 25/53] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:08 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:08.648836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:08.649565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:08.656537 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:08.657122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:08.658042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:08.658684 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:08.766625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:08.784436 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:08.794901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:08.817543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:08.820244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6f117b80-492f-429e-9421-f92a020a4250 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.177721 Jun 21 03:09:08.822495 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 29/54] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:08 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:08.999852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:09.000403 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:09.019556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.022741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.026695 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.029649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.148694 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:09.149351 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:09.164702 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.175725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.178486 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.186999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.599051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:09.627779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:09.630156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-638ff7a5-a056-4d45-b5e9-6572556c5f0f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1276 microversion: 2.1 time: 0.484155 Jun 21 03:09:09.633864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 30/55] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:09 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1276 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:09.640068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-006ae7ef-dafc-4586-8336-cddce269e56d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.643407 Jun 21 03:09:09.641514 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 26/56] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:08 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:09.646790 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:09.647660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:09.657840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.661321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.664063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:09.664212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.664954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.665057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:09.675326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.675798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.680001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:09.682200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:09.966318 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:09.987385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-40572921-56ad-45f6-813d-d4af48f6e808 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.343974 Jun 21 03:09:09.988230 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 27/57] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:09 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:09.995377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:09.996174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:10.003986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:10.004798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:10.005958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:10.006542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:10.105554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:10.119158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:10.120762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:10.123241 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2f6b5bb0-605f-4236-ae62-4bab386a1b65 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.132375 Jun 21 03:09:10.124198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 28/58] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:09 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:10.205137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:10.218177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4e3eed28-b4a4-45c6-a8b6-2c81123a0ca3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.579734 Jun 21 03:09:10.219305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:09 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:10.648654 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:10.650074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:10.658429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:10.659269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:10.676948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:10.677519 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:10.678125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:10.678734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:10.679653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:10.680754 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:10.681373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:10.681895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:10.980009 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:10.997627 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-66b5215b-705d-4b79-9222-3f783f038d36 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.343093 Jun 21 03:09:11.006382 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 32/60] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:10 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:11.022517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:11.023541 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:11.045214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:11.045815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:11.047552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:11.048129 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:11.074211 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:11.089672 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1559e7b0-3f75-4b42-bcd0-61d6afde819f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.446056 Jun 21 03:09:11.094806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 29/61] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:10 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:11.142277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:11.142382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:11.167303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:11.167856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:11.168723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:11.169150 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:11.181339 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:11.269132 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:11.279421 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:11.280963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:11.282072 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=4 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:11.282201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cb1d2235-8a6f-4faa-8df5-d4a124f1e933 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.145371 Jun 21 03:09:11.285745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 30/62] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:11 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:11.296210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:11.299018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:11.308971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:11.309302 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:11.310985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:11.311667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:11.418929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:11.432855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d0d6ee6d-7e2c-426a-930c-129c66a5ce1f tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.424985 Jun 21 03:09:11.433952 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:11 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:11.498059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:11.513961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-47fe316a-3f05-4ee6-abef-2315f92bd36a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.222947 Jun 21 03:09:11.515192 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 31/64] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:11 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:12.025421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:12.026118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:12.048873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:12.056015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.056498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.074456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.075030 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.115696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:12.116073 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:12.123833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.125798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.134806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.135608 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.478278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:12.490017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-43ae813a-8518-4d4f-b3bf-a19560c03502 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.379509 Jun 21 03:09:12.492731 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:12 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:12.505283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:12.512959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:12.524938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.525395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.526524 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.528202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.674074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:12.684307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:12.686231 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:12.687298 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1ff881e0-0022-4292-bb89-524a8007cc5c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.192550 Jun 21 03:09:12.697764 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:12 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:12.716403 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:12.718015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:12.734268 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.734268 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.735603 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.735779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.929957 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:12.951225 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-677147a4-501c-4cd5-9725-6068dad96f4d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.931446 Jun 21 03:09:12.951860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:12 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:12.968406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:12.980937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:12.989712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:12.995807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.996585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:12.998131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:12.998773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:13.001620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-34861383-e169-4ddd-a362-fcb063e4f44b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.312570 Jun 21 03:09:13.004821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 34/68] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:12 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:13.511457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:13.514381 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:13.524266 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=8 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:13.525382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=40 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:13.530202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:13.531622 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:13.532900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:13.533572 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:13.745556 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:13.762681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-04c97f9d-d063-48fc-9850-524b6a903a4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.796007 Jun 21 03:09:13.764547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 35/69] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:12 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:13.772810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:13.774764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:13.793483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=22 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:13.795515 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:13.795994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:13.802728 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:13.803184 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:14.078097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:14.106212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:14.113792 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:14.129592 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a4c50164-a56e-484b-b896-6c8742fa6572 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.363127 Jun 21 03:09:14.135231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:13 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:14.151688 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:14.156144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:14.187510 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:14.192071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:14.195611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:14.201491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:14.539191 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:14.547605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3bcb91c4-76fa-4b81-9315-5c81f39623a9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 1.039960 Jun 21 03:09:14.553331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 35/71] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:13 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:14.572225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:14.573634 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:14.591016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:14.591466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:14.592239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:14.598813 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:15.118509 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:15.137926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2549a727-5dcc-480b-a6f5-3ffa4454ccbc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.580697 Jun 21 03:09:15.149928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 36/72] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:14 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:15.162418 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:15.163043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:15.194314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:15.195377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:15.197349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:15.199406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:15.855976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:15.868901 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cf1a9e33-c8a8-406e-8b00-1327058046fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.714461 Jun 21 03:09:15.873808 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 37/73] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:15 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:15.901149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:15.901797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:15.926260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:15.926732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:15.927733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:15.931286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:15.950425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:15.961078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-99f59c34-7dce-469b-8fcf-02f3d9eeb6e0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 1.823780 Jun 21 03:09:15.968961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:14 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:15.976883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:15.979841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:15.994131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:15.997694 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.000746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:16.002584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.166586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:16.180010 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:16.182733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:16.185769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9212591e-d432-48c9-9d53-f9a31c39b6e9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1340 microversion: 2.20 time: 0.310796 Jun 21 03:09:16.189647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 38/75] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:15 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1340 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:16.214494 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:16.216677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:16.229495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:16.231501 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.233310 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:16.235165 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.539569 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:16.565201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3d73aad9-9487-42a4-9092-770dcbce7730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.372662 Jun 21 03:09:16.577992 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 39/76] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:16 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:16.911069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-59d87894-53ab-49bc-875c-9c41ffc26ae7 req-4d88aebd-93a4-49ee-87b9-6088bd55cb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c12ba-1c44-43ad-9450-eea9f7b74332", "tag": "2f44f583-f139-4fef-81d7-43b8032d3a1a"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:16.934393 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-59d87894-53ab-49bc-875c-9c41ffc26ae7 req-4d88aebd-93a4-49ee-87b9-6088bd55cb54 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:16.934838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-59d87894-53ab-49bc-875c-9c41ffc26ae7 req-4d88aebd-93a4-49ee-87b9-6088bd55cb54 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.961556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-59d87894-53ab-49bc-875c-9c41ffc26ae7 req-4d88aebd-93a4-49ee-87b9-6088bd55cb54 service nova] Creating event network-changed:2f44f583-f139-4fef-81d7-43b8032d3a1a for instance 840c12ba-1c44-43ad-9450-eea9f7b74332 on hv-cinder-84684 Jun 21 03:09:16.962086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-59d87894-53ab-49bc-875c-9c41ffc26ae7 req-4d88aebd-93a4-49ee-87b9-6088bd55cb54 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 03:09:16.963363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:16.963799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.964587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:16.965155 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:16.978156 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.compute.rpcapi [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 03:09:16.979408 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 03:09:17.011267 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-09b65632-ba0e-4618-beb3-c12167f409d6 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211798 Jun 21 03:09:17.012245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 40/77] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:09:17.018928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:17.019849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:17.039405 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.039931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.040741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.041319 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.166666 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.173929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-86f697c5-1333-4a22-a229-35a97f471245 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 1.203640 Jun 21 03:09:17.180456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 38/78] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:15 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:17.186011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:17.189082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:17.206078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.206747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.207637 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.209625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.249109 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.264737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6c7883bb-f012-4c8f-93be-8db6c5b2164d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.250352 Jun 21 03:09:17.278817 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 41/79] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:17 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:17.293281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:17.294553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:17.302934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.303769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.304906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.305582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.517208 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.542353 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.544523 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.545903 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9449c385-91f4-435f-8b75-b59e9f9f8632 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.265425 Jun 21 03:09:17.546899 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 42/80] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:17 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:17.584129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:17.585435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:17.592892 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.593499 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.594291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:17.594810 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:17.740092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.749497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8f366842-fb1f-42f5-8b84-48d30c516d8b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.170563 Jun 21 03:09:17.760092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 43/81] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:17 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:17.772589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:17.782635 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-74b441cb-839d-491f-a1c6-50374c7ecade tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.600698 Jun 21 03:09:17.783739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 39/82] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:17 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:18.091854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-fc8a3ce8-6d9a-4082-8337-da26a030f538 req-d8c7b6b0-e8b3-4815-aa98-2929f0cbe9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "571b42e5-3e2d-4bd4-8e97-5f09fff9b63d", "tag": "206224fe-0847-4816-a95b-3775f0529b12"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:18.102461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-fc8a3ce8-6d9a-4082-8337-da26a030f538 req-d8c7b6b0-e8b3-4815-aa98-2929f0cbe9d4 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.102895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-fc8a3ce8-6d9a-4082-8337-da26a030f538 req-d8c7b6b0-e8b3-4815-aa98-2929f0cbe9d4 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.118549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-fc8a3ce8-6d9a-4082-8337-da26a030f538 req-d8c7b6b0-e8b3-4815-aa98-2929f0cbe9d4 service nova] Creating event network-changed:206224fe-0847-4816-a95b-3775f0529b12 for instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d on hv-cinder-84684 Jun 21 03:09:18.124999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-fc8a3ce8-6d9a-4082-8337-da26a030f538 req-d8c7b6b0-e8b3-4815-aa98-2929f0cbe9d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094893 Jun 21 03:09:18.125911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 44/83] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:18.197310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:18.198572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:18.205056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.205595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.206468 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.207066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.285216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:18.286351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:18.294177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.294723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.295688 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.296247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.386559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.396281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-047bed94-101c-494f-94cd-d64379210a57 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.202822 Jun 21 03:09:18.405236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 40/84] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:18 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:18.457936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.465498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2c9727e7-ff72-4e63-83ca-c0fd4be35f1d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.184850 Jun 21 03:09:18.471539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 45/85] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:18 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:18.563763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:18.564362 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:18.570894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.571336 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.572093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.572551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.708356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.716926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.718432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.719558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-40870f80-be49-4c49-b41a-6e97a633d63e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.160192 Jun 21 03:09:18.720123 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 41/86] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:18 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:18.769986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:18.770740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:18.778872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.779314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.780071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.780535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.800517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:18.801075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:18.807365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.807822 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.808617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:18.809097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:18.911079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.918969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3c25cd36-29b3-4626-b5d4-b961a8a91c7b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.155286 Jun 21 03:09:18.919542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 46/87] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:18 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:18.951017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:18.958646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2f124880-77cc-48b4-9235-3a1287b51bf2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.162419 Jun 21 03:09:18.959196 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:18 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:19.027044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-23e76c73-7869-4d2b-a9c8-91b33db2a2f4 req-3a35a6a0-5523-405c-916a-c18e0dd1178a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa1873d-908f-4d20-b5f3-5c6c74ea0294", "tag": "b35ccf44-ec65-4aac-bc20-97be5d1a8d07"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:19.035493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-23e76c73-7869-4d2b-a9c8-91b33db2a2f4 req-3a35a6a0-5523-405c-916a-c18e0dd1178a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.035926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-23e76c73-7869-4d2b-a9c8-91b33db2a2f4 req-3a35a6a0-5523-405c-916a-c18e0dd1178a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.048231 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-23e76c73-7869-4d2b-a9c8-91b33db2a2f4 req-3a35a6a0-5523-405c-916a-c18e0dd1178a service nova] Creating event network-changed:b35ccf44-ec65-4aac-bc20-97be5d1a8d07 for instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 on hv-cinder-84684 Jun 21 03:09:19.054019 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-23e76c73-7869-4d2b-a9c8-91b33db2a2f4 req-3a35a6a0-5523-405c-916a-c18e0dd1178a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030191 Jun 21 03:09:19.054670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 47/89] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:19.413722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:19.414323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:19.420859 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.421313 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.422076 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.422508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.483728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:19.484437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:19.491074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.491515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.492243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.492708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.511096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:19.565513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:19.573126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-68d9b0e2-4839-440f-bc28-fd6877533ce6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.163253 Jun 21 03:09:19.573693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 43/90] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:19 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:19.738429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:19.739130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:19.745966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.746406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.747485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.747920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.787019 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:19.794653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b5e564d5-0e48-4766-ad99-1355ba378b4d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.315150 Jun 21 03:09:19.795323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 48/91] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:19 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:19.879971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:19.888294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:19.889938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:19.891042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cb370713-5935-4253-9e5a-84875fa7dcc6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.156924 Jun 21 03:09:19.891620 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 44/92] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:19 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:19.939967 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:19.940728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:19.947271 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.947718 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.948504 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.948934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.975810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:19.976500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:19.983028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.983540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:19.984296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:19.984751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.097520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:20.107028 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-24fdf1c9-ce77-4981-8039-7586158a670e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.173181 Jun 21 03:09:20.107772 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 49/93] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:19 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:20.143786 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-881d6cb2-0bc3-46f9-9b1a-e85776e7f98f req-1238af4a-6b08-40ce-8897-4d7cb9676d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416a380b-f69e-4101-8c88-d26221caf707", "tag": "7dcab122-3477-4e02-b7aa-acd704037607"}, {"name": "network-changed", "server_uuid": "dc9a9acd-00f9-4181-b4db-70d6ad6930e7", "tag": "dea46eac-9326-474c-8b29-1ce4d2d9cada"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:20.156804 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-881d6cb2-0bc3-46f9-9b1a-e85776e7f98f req-1238af4a-6b08-40ce-8897-4d7cb9676d5a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.157469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-881d6cb2-0bc3-46f9-9b1a-e85776e7f98f req-1238af4a-6b08-40ce-8897-4d7cb9676d5a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.172759 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:20.173344 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-881d6cb2-0bc3-46f9-9b1a-e85776e7f98f req-1238af4a-6b08-40ce-8897-4d7cb9676d5a service nova] Creating event network-changed:7dcab122-3477-4e02-b7aa-acd704037607 for instance 416a380b-f69e-4101-8c88-d26221caf707 on hv-cinder-84684 Jun 21 03:09:20.173886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-881d6cb2-0bc3-46f9-9b1a-e85776e7f98f req-1238af4a-6b08-40ce-8897-4d7cb9676d5a service nova] Creating event network-changed:dea46eac-9326-474c-8b29-1ce4d2d9cada for instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 on hv-cinder-84684 Jun 21 03:09:20.181379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-881d6cb2-0bc3-46f9-9b1a-e85776e7f98f req-1238af4a-6b08-40ce-8897-4d7cb9676d5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041192 Jun 21 03:09:20.181843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5fa4c7ce-6009-49f3-9f42-4f0ead401d71 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.210151 Jun 21 03:09:20.182375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 50/94] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:09:20.182800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 45/95] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:19 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:20.590921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:20.597805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:20.607397 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.607840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.608647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.609061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.781430 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:20.789193 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d5673b05-d406-4dc7-b782-03deedb0f24f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.202625 Jun 21 03:09:20.789763 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 51/96] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:20 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:20.812665 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:20.813283 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:20.819743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.820190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.821019 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.821433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.848972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:20.913569 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:20.913898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:20.920861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.921434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.922300 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:20.922730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:20.978524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:20.985978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4f7cc9da-8a76-4625-afac-890c2509d7f8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.177695 Jun 21 03:09:20.986804 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 46/97] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:20 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:21.069272 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:21.078109 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:21.079597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:21.080742 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-de34211c-fc01-4747-bf29-c06a58948184 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.174943 Jun 21 03:09:21.081402 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 52/98] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:20 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:21.124906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:21.125560 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:21.132640 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:21.133075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:21.133836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:21.134258 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:21.199517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:21.200114 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:21.206693 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:21.206890 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:21.207886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:21.208467 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:21.279826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:21.292623 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5c00cf9e-4542-45b4-80cc-f747981b3a05 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.171845 Jun 21 03:09:21.293771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 47/99] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:21 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:21.351450 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:21.359530 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-84514a1f-95fe-4e1e-9308-47d3528cc453 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.164029 Jun 21 03:09:21.360337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 53/100] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:21 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:21.807168 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:21.807816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:21.815632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:21.816894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:21.817856 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:21.818442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.005324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:22.005975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:22.020157 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.022777 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.023970 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.024539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.052383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.061969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-904d0d30-d9a1-4a98-9f89-03eff6b101f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.259188 Jun 21 03:09:22.062673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 48/101] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:21 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:22.099328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:22.100301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:22.110572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.111270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.112350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.113701 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.254564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.264665 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5bbe8100-ba51-4bf2-9418-696534870cec tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.264513 Jun 21 03:09:22.265760 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 54/102] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:21 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:22.310622 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:22.311230 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:22.322095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.322938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.323950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.324806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.365809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.381431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.383807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.385158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a1ca895e-e90e-4f78-a8bb-00694513c429 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.290128 Jun 21 03:09:22.396798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 49/103] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:22 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:22.401844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:22.402452 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:22.410903 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.411402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.412187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:22.412674 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:22.535334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.543540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f033118f-18f1-431f-83e8-0ceca5f81156 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.237253 Jun 21 03:09:22.544857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 55/104] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:22 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:22.601040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:22.611141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-65358341-42e5-47c8-ae87-4530351559a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.213001 Jun 21 03:09:22.612363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 50/105] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:22 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:23.080061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:23.081104 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:23.087714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.088156 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.088953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.089383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.242556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.252193 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0c9634c5-b424-4f96-b212-eb2aa84e1baa tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.176628 Jun 21 03:09:23.253452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 56/106] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:23 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:23.282120 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:23.282702 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:23.289117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.289576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.290313 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.290734 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.404590 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:23.405296 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:23.411694 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.412378 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.413365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.413761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.439310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.448086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-78a8482f-a240-4263-93d2-6746f694ba62 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.169791 Jun 21 03:09:23.448692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 51/107] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:23 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:23.560584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:23.561227 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:23.564210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.567500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.567934 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.568784 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.569214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.572425 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.573905 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.574999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2b0abe90-0120-4db7-8550-8bef9ae49dfc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.174924 Jun 21 03:09:23.575715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 57/108] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:23 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:23.633692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:23.634446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:23.641575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.642108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.642956 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:23.643626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:23.722494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.730298 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-46528444-ad0d-4472-9157-a6d4eb1d9f79 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.173578 Jun 21 03:09:23.730888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 52/109] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:23 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:23.822077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:23.831254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cbd50bb8-1e2f-45fc-97ba-2c764e0f140b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.205744 Jun 21 03:09:23.831827 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 58/110] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:23 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:24.272876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:24.273662 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:24.281818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.282291 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.283234 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.283814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.433187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:24.441037 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-54f0461a-9f52-45f6-a678-1b673581900d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.173494 Jun 21 03:09:24.442130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 53/111] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:24 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:24.468803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:24.470033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:24.477610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.478049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.478791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.479214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.594485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:24.595135 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:24.601825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.602272 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.603026 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.603455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.621442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:24.629661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6341a70e-b481-4fb1-9614-b225b873238a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.167315 Jun 21 03:09:24.630220 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 59/112] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:24 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:24.747887 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:24.748778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:24.751891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:24.756039 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.756514 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.757255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.757702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.902952 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:24.910581 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f62b4a23-682a-43ca-a66f-99f424ceaab9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.167001 Jun 21 03:09:24.911135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 60/113] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:24 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:24.913201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:24.918381 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:24.919078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:24.921667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:24.923144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:24.924292 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-55fd0c4b-ec94-4eb7-8cb4-0df5814a43c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.333807 Jun 21 03:09:24.924907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 54/114] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:24 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:24.925167 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.925659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:24.926558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:24.926984 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.069904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:25.079244 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a56ee4bf-5456-4edb-b0c3-c79eb584f12b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.165396 Jun 21 03:09:25.080006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 61/115] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:24 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:25.458892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:25.459493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:25.466300 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.466745 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.467512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.467944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.600782 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:25.608300 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ccf672a0-1c00-49a0-8aa3-bc9c116a25a5 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.153616 Jun 21 03:09:25.608896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 55/116] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:25 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:25.646789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:25.648037 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:25.654748 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.655196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.655958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.656383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.807306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:25.815213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff17741a-e1f2-45ca-aaf6-52d7e603f246 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.172194 Jun 21 03:09:25.815765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 62/117] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:25 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:25.930980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:25.931696 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:25.939752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.940326 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.941228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.941721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.944591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:25.945226 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:25.952449 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.955543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:25.955543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:25.955543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.122962 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:26.132783 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:26.136915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5e23a928-26d6-40a6-8c62-70e0ea60ee0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.210948 Jun 21 03:09:26.146730 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 56/118] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:25 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:26.146939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:26.147164 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:26.147270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:26.147372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:26.147463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fe06de46-22bf-4c42-b593-433eedb8310b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.205811 Jun 21 03:09:26.154143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 63/119] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:25 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:26.159502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:26.160116 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.162993 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:26.163413 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.294775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:26.302920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ed056b6b-c75b-4dfa-8bd3-b301a6cebace tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.164022 Jun 21 03:09:26.303809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 57/120] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:26 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:26.628814 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:26.629306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:26.635935 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:26.636370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.637140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:26.637563 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.770321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:26.778214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-752d4e2b-8455-474a-a08d-342b76549f79 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.154826 Jun 21 03:09:26.778776 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 64/121] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:26 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:26.835659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:26.836665 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:26.846242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:26.846940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.847953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:26.848388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:26.999788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.007611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-aa7b0fbe-3fc7-475e-8f6f-1ffd8bc465e5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.177837 Jun 21 03:09:27.008180 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 58/122] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:26 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:27.154000 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:27.154633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:27.156531 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:27.163625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:27.164222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:27.164362 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.165102 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.165516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.165948 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.170551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.170983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.172070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.172519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.301824 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.303516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.305259 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:27.309680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a54a538f-db6d-4adc-856e-b95c0097e8e2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.159495 Jun 21 03:09:27.310242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 65/123] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:27 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:27.311872 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.313418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.314972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-22b68fd1-c4f3-46b1-b2c1-d77a329a65f7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.155314 Jun 21 03:09:27.315657 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 59/124] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:27 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:27.322822 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:27.323417 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:27.330298 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.330732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.331468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.331985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.467088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.475219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-159794bd-4a70-4911-a8c7-b214fc02e6dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.159789 Jun 21 03:09:27.475779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 66/125] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:27 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:27.798261 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:27.799163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:27.806303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.806737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.807496 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:27.807928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:27.943228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:27.950992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-89b24808-56a0-474f-b5e6-ed98ab6c114d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.158400 Jun 21 03:09:27.951585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 60/126] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:27 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:28.025139 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:28.025735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:28.032356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.032833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.033568 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.033994 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.164712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:28.172754 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3d8566c6-d34b-4cb2-be12-0381e25cdedb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.151426 Jun 21 03:09:28.173426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 67/127] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:28 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:28.331245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:28.331970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:28.336572 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:28.337350 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:28.338285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.338736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.339478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.339909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.343769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.344272 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.345062 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.345496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.483748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:28.493313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:28.494762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c7f55f2d-57bb-4636-82ee-cb72470ea661 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.169855 Jun 21 03:09:28.495350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 61/128] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:28 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:28.501798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:28.502589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:28.506612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:28.508779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:28.509788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.510246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.510585 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0d028594-16dc-4b13-a698-296fc09eb346 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.181294 Jun 21 03:09:28.511004 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.511431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.511737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 68/129] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:28 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:28.669397 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:28.677305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5eeb6ce7-2d55-42a4-854c-db7ad1385bd9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.180761 Jun 21 03:09:28.677868 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 62/130] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:28 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:28.971774 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:28.972865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:28.980999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.981453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:28.982364 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:28.983044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.147435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:29.157696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-618f4f80-382e-47d7-a89d-fdcd82f3fad4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.192040 Jun 21 03:09:29.158666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 69/131] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:28 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:29.191454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:29.192064 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:29.198774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.199211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.199956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.200381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.204683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:29.434964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:29.442946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1cdc6381-4f95-4778-8bcf-285f28d710a7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.255539 Jun 21 03:09:29.443458 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 63/132] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:29 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:29.511860 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:29.512400 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:29.518895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.519413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.520227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.520710 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.529394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:29.530001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:29.537276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.537723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.538572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.538976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.776066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:29.783745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-58f060d9-e92a-4f4a-bcfb-8cb4d9ccfdce tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.275897 Jun 21 03:09:29.784443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 70/133] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:29 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:29.789630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:29.790127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:29.796164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.796835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:29.797505 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:29.797936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.072805 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.082017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.084431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.085882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8390c39e-29c0-4db6-8efc-9cca02441f79 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.560437 Jun 21 03:09:30.086742 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 64/134] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:29 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:30.135503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.143134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b8846f85-f569-4f46-bb42-b6768a7b6728 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.357532 Jun 21 03:09:30.143707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:29 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:30.178282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:30.178896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:30.187423 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.187874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.188720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.189172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.459793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:30.461125 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:30.467573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.468015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.468816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.469238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.615160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.623489 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dbec45cd-3b66-471c-98de-944b051b7370 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.167993 Jun 21 03:09:30.624319 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 72/136] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:30 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:30.658689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.666261 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-91191128-8aa4-4eb3-b3d5-59da0f3c22c0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.493060 Jun 21 03:09:30.666796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 65/137] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:30 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:30.793210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-c3be2eb9-3a58-4e3a-8e37-f91b06ec9b44 req-a74dff68-2551-4489-a3ac-3a57de48e4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:30.800518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:30.801082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:30.803385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c3be2eb9-3a58-4e3a-8e37-f91b06ec9b44 req-a74dff68-2551-4489-a3ac-3a57de48e4f9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.804048 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c3be2eb9-3a58-4e3a-8e37-f91b06ec9b44 req-a74dff68-2551-4489-a3ac-3a57de48e4f9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.811796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.812257 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.813055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:30.813477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:30.823538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-c3be2eb9-3a58-4e3a-8e37-f91b06ec9b44 req-a74dff68-2551-4489-a3ac-3a57de48e4f9 service nova] Creating event network-changed:a6a84e7e-f693-4251-bff2-a21fced5ba19 for instance bade48e3-65d3-406d-8d36-53e1f560e554 on hv-cinder-84684 Jun 21 03:09:30.828713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-c3be2eb9-3a58-4e3a-8e37-f91b06ec9b44 req-a74dff68-2551-4489-a3ac-3a57de48e4f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039416 Jun 21 03:09:30.829857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 73/138] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:30.949530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:30.958000 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-51d03f63-565f-4c72-9dfb-a8a10974cc11 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.161715 Jun 21 03:09:30.958566 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 66/139] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:30 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:31.108629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:31.110131 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:31.119463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.119463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.120247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.120694 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.159587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:31.160272 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:31.166850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.167289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.168055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.168521 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.255784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:31.263880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:31.265385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:31.266478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5ef2fae2-d13e-4433-803e-498b96116f0e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.166164 Jun 21 03:09:31.267013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 74/140] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:31 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:31.306707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:31.314407 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cca8e8da-e07b-4f3d-a737-99caef9a8187 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.158848 Jun 21 03:09:31.314945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 67/141] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:31 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:31.644958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:31.645509 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:31.652833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.653295 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.654079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.654526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.682781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:31.683389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:31.689689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.690119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.690859 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.691369 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.795315 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:31.802939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-41a633df-5745-477d-b8ba-754837dabd53 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.164501 Jun 21 03:09:31.803477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 75/142] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:31 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:31.823281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:31.830751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a0f61098-977d-41dc-a41b-457d05f617b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.151832 Jun 21 03:09:31.831305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 68/143] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:31 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:31.978406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:31.979320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:31.987601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.988194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:31.989462 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:31.990127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.136965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.147482 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-86c2b50c-9449-45e5-9dce-4bfd6d6a2eac tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.175086 Jun 21 03:09:32.148047 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 76/144] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:31 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:32.288001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:32.288951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:32.298456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.299143 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.300274 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.300887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.330930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:32.331868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:32.338293 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.338733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.339478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.339897 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.434833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.445433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.446901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.448338 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-793b95c6-062f-479a-b1d2-e30a2d1b65b2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.166675 Jun 21 03:09:32.448899 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 69/145] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:32 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:32.476031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.483845 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-715ab6d0-0c9f-43ca-8961-140670d595fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.156670 Jun 21 03:09:32.484442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 77/146] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:32 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:32.823633 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:32.824653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:32.834964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.835700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.836999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.837749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.849914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:32.850521 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:32.856913 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.857359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.858116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:32.858547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:32.972348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.979840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-609a1e6e-7f56-44fd-9f27-93eda8cc6762 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.162550 Jun 21 03:09:32.980401 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 70/147] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:32 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:32.991083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:32.999150 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-47b16a20-67a9-4190-9f7e-9c45f2f5c84f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.154721 Jun 21 03:09:32.999682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 78/148] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:32 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:33.171057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:33.171909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:33.179883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:33.180325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:33.181103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:33.181525 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:33.317088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:33.324683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6162816b-73b6-46cc-8bbb-f08ae7757bfc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.160027 Jun 21 03:09:33.325243 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 71/149] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:33 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:33.470758 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:33.471757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:33.478578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:33.479023 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:33.479773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:33.480183 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:33.501901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:33.502710 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:33.509474 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:33.509920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:33.510659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:33.511266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:33.977606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:33.985390 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:33.985881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c0722d57-912e-445a-80da-69b4517ebf84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.488434 Jun 21 03:09:33.986909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 72/150] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:33 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:33.996618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:33.997516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:34.001574 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:34.003466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:34.005012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-87f75821-c726-4122-96e9-7dd9f4005a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.540672 Jun 21 03:09:34.005790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 79/151] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:33 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:34.016301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:34.016799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:34.017988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:34.018418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:34.018550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:34.019252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:34.025632 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:34.026252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:34.027011 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:34.027438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:34.156682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:34.162965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:34.165612 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d7396920-c53f-4d3c-a434-5dd8b4ff8476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.172719 Jun 21 03:09:34.166179 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 73/152] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:33 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:34.171245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e4ae516e-a841-4da1-bb51-2e3ae3eb2887 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.159757 Jun 21 03:09:34.171775 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 80/153] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:34 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:34.347482 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:34.348079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:34.354433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:34.354877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:34.355661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:34.356109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:34.777852 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:34.788280 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3481d043-e593-4372-a047-d4eeb9062da6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.448017 Jun 21 03:09:34.789133 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 74/154] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:34 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:35.004192 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:35.005403 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:35.012391 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.012937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.013758 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.014252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.023456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:35.025103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:35.031721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.032480 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.033463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.034075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.334255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:35.343344 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-221b0eb9-3d25-4e3d-a410-b52e67c2e42b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.343472 Jun 21 03:09:35.354044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 81/155] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:34 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:35.359749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:35.360589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:35.382601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.399554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.400656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.401998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.425571 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:35.441048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:35.444771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:35.450275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8783b7d7-698d-420e-9690-b86a7b92c977 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.426638 Jun 21 03:09:35.459330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 75/156] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:35 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:35.459330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:35.459330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:35.463706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.464147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.464919 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.465344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.556983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:35.568394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e8e1f1bc-3fad-4740-bcd1-e3a7870c5273 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.212868 Jun 21 03:09:35.578653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 82/157] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:35 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:35.600516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:35.618355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-759906b7-7356-461b-9ea8-e5ccf94a173a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.166013 Jun 21 03:09:35.619127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 76/158] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:35 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:35.805620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:35.806735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:35.814458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.815097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.816262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:35.816905 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:35.821394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:36.010006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.021944 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-39485f03-d9f4-4df8-b7d5-ff003cda62bc tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.220328 Jun 21 03:09:36.022518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 83/159] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:35 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:36.364324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:36.365059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:36.373361 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.373955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.374886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.375420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.468294 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:36.468921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:36.475581 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.476022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.476802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.477225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.508006 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.515802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-097f7475-d974-4668-bfc9-1ecfbea5c2dc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.157522 Jun 21 03:09:36.516391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 77/160] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:36 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:36.585959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:36.586561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:36.592675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.593181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.593934 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.594360 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.607429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.615803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.617331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.618438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-95184dd0-69bd-43cb-86ab-78de895018e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.153996 Jun 21 03:09:36.618996 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 84/161] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:36 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:36.635527 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:36.636132 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:36.642321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.642765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.643516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:36.644123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:36.725485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.732980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0da9c227-951f-46e8-9e2c-b2d848666521 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.150876 Jun 21 03:09:36.733621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 78/162] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:36 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:36.782502 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:36.790511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7a174ae9-0487-4a05-ae9d-aef0c793cd00 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.158643 Jun 21 03:09:36.791043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 85/163] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:36 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:37.038887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:37.039840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:37.047873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.048466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.049331 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.049885 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.258499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:37.262130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:37.272543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b3b924a9-2452-426e-916e-f874b3093232 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.237310 Jun 21 03:09:37.282339 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 79/164] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:37 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:37.533229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:37.533901 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:37.540197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.540770 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.541588 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.542092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.636507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:37.637762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:37.644405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.645099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.646292 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.646724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.677218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:37.684924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f53c56f5-2c3d-427a-9fa9-2184d3f1c2ff tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.155450 Jun 21 03:09:37.685719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 86/165] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:37 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:37.752235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:37.752978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:37.759480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.759973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.760961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.761646 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.794399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:37.807861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:37.809418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:37.810533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1507c285-cf94-4961-8337-d80f770decb1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.178436 Jun 21 03:09:37.811251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 80/166] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:37 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:37.821308 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:37.822152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:37.829837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.830330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.831795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:37.832499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:37.902088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:37.910384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e3ac2eac-cd2b-42a8-a587-5d0dc11a1bc7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.163730 Jun 21 03:09:37.911365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 87/167] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:37 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:38.047043 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:38.054898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4c80c0db-f8b2-459b-bc90-48c988993b28 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.242509 Jun 21 03:09:38.055649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 81/168] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:37 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:38.289786 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:38.290370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:38.296696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.297319 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.298061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.298474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.436904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:38.448719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ae3058e8-9ed4-4574-920b-9a1e5a2e5d19 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.162791 Jun 21 03:09:38.449482 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 88/169] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:38 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:38.702591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:38.703274 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:38.709758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.710264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.711041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.711505 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.829213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:38.829851 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:38.836659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.837096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.837857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.838273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.882364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:38.891502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3411d27c-7121-4842-a4cf-2de5a97dbd6d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.193172 Jun 21 03:09:38.892075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 82/170] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:38 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:38.927190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:38.927794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:38.934104 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.934550 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.935317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:38.935747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:38.972171 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:38.980297 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:38.981837 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:38.983051 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-85f267f0-d3c0-46c1-bd72-a2077d17dfdd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.158120 Jun 21 03:09:38.983608 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 89/171] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:38 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:39.075222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:39.075832 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:39.082486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:39.082931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:39.083698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:39.084129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:39.176293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:39.184819 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d8b5115b-eafa-48d9-a1d8-1149445ea781 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.261601 Jun 21 03:09:39.185387 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 83/172] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:38 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:39.224882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:39.234884 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ad26e903-7f00-4376-8242-e2b804c8c009 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.163723 Jun 21 03:09:39.235558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 90/173] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:39 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:39.465911 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:39.467193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:39.470409 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:39.474529 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:39.474969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:39.475821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:39.476248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:39.644811 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:39.659257 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0d0609fa-0afa-4036-ae2a-f059a1dcd990 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.196831 Jun 21 03:09:39.660441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 84/174] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:39 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:39.915267 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:39.917656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:39.926385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:39.927136 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:39.928708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:39.929485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.004807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:40.009458 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:40.016982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.017445 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.018211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.018641 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.126996 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.136536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3dd39a90-741d-4d23-aa80-c08bcba520a8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.231932 Jun 21 03:09:40.137638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 91/175] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:39 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:40.205699 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.210800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:40.211449 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:40.218975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.220488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.221591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e41a604b-cc07-441f-b6ff-6a8fda41c89a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.224678 Jun 21 03:09:40.225703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.226144 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.226902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.227329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.231648 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 85/176] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:39 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:40.253693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:40.254928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:40.267842 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.268438 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.270323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.272030 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.454705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.466800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-54102412-a075-45ee-8a06-9a3e6ac20e69 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.266566 Jun 21 03:09:40.467773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 92/177] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:40 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:40.496281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.508597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3eb3a41e-065c-4270-beb5-c60b3a00d6de tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.259595 Jun 21 03:09:40.509165 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 86/178] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:40 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:40.675857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:40.677411 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:40.686396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.687158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.688178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:40.688846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:40.898247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:40.906140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9e8dfcc9-daf3-487b-8beb-ca788a8a2e0b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.234063 Jun 21 03:09:40.907159 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 93/179] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:40 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:41.153656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:41.154264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:41.173764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.174210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.174973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.175434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.239364 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:41.240635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:41.246696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.247457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.248200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.248854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.357202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:41.372713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4f5608fd-575a-48bc-9f60-58ad6703bf26 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.222582 Jun 21 03:09:41.374693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 87/180] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:41 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:41.419379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:41.429411 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:41.431143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:41.432300 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-764b0287-670f-430c-b730-1a374e8f83a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.197060 Jun 21 03:09:41.432908 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 94/181] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:41 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:41.488960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:41.489877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:41.497027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.497910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.498825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.499440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.527501 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:41.528189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:41.538097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.538547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.539554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.540332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.714679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:41.731653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-aa48ee57-4224-4e11-ac09-45cfcb1c49fd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.247410 Jun 21 03:09:41.741449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 88/182] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:41 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:41.787286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:41.795164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-77c5a7b3-a34e-4734-ae48-ffe548aaec43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.272825 Jun 21 03:09:41.804528 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 95/183] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:41 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:41.924357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:41.925861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:41.932518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.934099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:41.934946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:41.935863 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.103524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:42.111556 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-090478fa-b628-4cdb-8445-4e330d26a0b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.191121 Jun 21 03:09:42.112321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 89/184] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:41 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:42.390564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:42.391799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:42.401560 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.402331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.403761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.404379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.466586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:42.468391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:42.486527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.488308 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.489162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.489599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.841763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:42.852921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:42.855107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:42.860782 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4c89179e-099d-4f85-aa8b-7be597be9f74 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.404678 Jun 21 03:09:42.862152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 90/185] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:42 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:42.869439 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:42.870306 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:42.879405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.880174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.881887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.882538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.900351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:42.911691 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1681b3d3-1f40-43d3-aa99-a1a3893c9aca tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.525418 Jun 21 03:09:42.924470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 96/186] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:42 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:42.931425 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:42.933988 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:42.945492 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.946474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:42.948635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:42.949410 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.085631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:43.093548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7fd4380b-2950-4ef5-b7eb-2785859d1d68 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.229620 Jun 21 03:09:43.094467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 91/187] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:42 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:43.232086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:43.242936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6ed91684-49d5-426e-ac48-50e13079162e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.315404 Jun 21 03:09:43.245526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 97/188] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:42 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:43.255263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:43.260212 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:43.275401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.277277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.280721 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.281194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.320333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-27c63281-5d9e-4a32-a7de-2a3c2baff43b req-048b6457-cf91-4dc4-a847-428bc2266933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416a380b-f69e-4101-8c88-d26221caf707", "name": "network-vif-plugged", "status": "completed", "tag": "7dcab122-3477-4e02-b7aa-acd704037607"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:43.357451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-27c63281-5d9e-4a32-a7de-2a3c2baff43b req-048b6457-cf91-4dc4-a847-428bc2266933 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.359123 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-27c63281-5d9e-4a32-a7de-2a3c2baff43b req-048b6457-cf91-4dc4-a847-428bc2266933 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.415108 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-27c63281-5d9e-4a32-a7de-2a3c2baff43b req-048b6457-cf91-4dc4-a847-428bc2266933 service nova] Creating event network-vif-plugged:7dcab122-3477-4e02-b7aa-acd704037607 for instance 416a380b-f69e-4101-8c88-d26221caf707 on hv-cinder-84684 Jun 21 03:09:43.416349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-27c63281-5d9e-4a32-a7de-2a3c2baff43b req-048b6457-cf91-4dc4-a847-428bc2266933 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 03:09:43.417914 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.418652 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.420403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.421011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.432916 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.compute.rpcapi [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 03:09:43.434560 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] Releasing lock "compute-rpcapi-router" {{(pid=117663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 03:09:43.463830 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b3ff2395-e735-4ed4-aa15-b4022ab0d27e None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367883 Jun 21 03:09:43.464755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 92/189] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:43.496861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:43.506307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a458f0f7-31b2-41ca-9a37-8bb7f7b03ee6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.259413 Jun 21 03:09:43.507129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 98/190] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:43 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:43.881067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:43.881987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:43.889114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.889557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.890497 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.890926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.929704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:43.931386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:43.941273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.942051 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:43.943261 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:43.943917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.049599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.058673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.061967 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.063087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d14f2fb5-1c0e-4598-9792-115e76b9fd2a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.188352 Jun 21 03:09:44.063640 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 93/191] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:43 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:44.131198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:44.140056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:44.154611 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.159547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:44.168259 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-de9d0578-fef5-4bb5-a99d-542df4ea342c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.242114 Jun 21 03:09:44.168994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:44.169644 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.170673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:44.171641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 99/192] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:43 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:44.172862 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.267604 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:44.270930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:44.279929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:44.280696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.281898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:44.282568 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.726193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.744671 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a34a61b0-d706-4889-9e63-02b74baea901 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.624340 Jun 21 03:09:44.753380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.758540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 94/193] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:44 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:44.764203 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-926074c3-c9dc-43fb-a9cc-4290af21730f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.504563 Jun 21 03:09:44.764975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 100/194] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:44 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:44.767312 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:44.772629 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:44.784151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:44.785282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.786652 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:44.790577 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:44.988843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:44.998411 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-83475e42-ce9a-432b-b1f9-100a5c5a917d tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.237929 Jun 21 03:09:44.999028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 95/195] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:44 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:45.082434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:45.083049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:45.089325 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.089775 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.091324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.091756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.187360 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:45.187963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:45.198821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.199635 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.200619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.202571 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.275191 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:45.284622 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:45.286474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:45.287602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6bdfb890-a50d-4277-997a-cd8d44f6d8b3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.209312 Jun 21 03:09:45.288170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 101/196] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:45 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:45.373551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:45.380652 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:45.383730 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-236a7b81-754f-4196-9b5d-bca827f9a4d1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.200417 Jun 21 03:09:45.384304 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 96/197] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:45 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:45.576354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-4f1f7a04-edce-41e8-afca-5e4b5916daac req-e45a5d42-a615-4591-9575-85006bd7a284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc9a9acd-00f9-4181-b4db-70d6ad6930e7", "name": "network-vif-plugged", "status": "completed", "tag": "dea46eac-9326-474c-8b29-1ce4d2d9cada"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:45.585290 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-4f1f7a04-edce-41e8-afca-5e4b5916daac req-e45a5d42-a615-4591-9575-85006bd7a284 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.585893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-4f1f7a04-edce-41e8-afca-5e4b5916daac req-e45a5d42-a615-4591-9575-85006bd7a284 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.598495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-4f1f7a04-edce-41e8-afca-5e4b5916daac req-e45a5d42-a615-4591-9575-85006bd7a284 service nova] Creating event network-vif-plugged:dea46eac-9326-474c-8b29-1ce4d2d9cada for instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 on hv-cinder-84684 Jun 21 03:09:45.604007 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-4f1f7a04-edce-41e8-afca-5e4b5916daac req-e45a5d42-a615-4591-9575-85006bd7a284 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032187 Jun 21 03:09:45.604790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 102/198] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:45.765455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:45.765972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:45.772544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.773071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.773811 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.774231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.783566 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:45.784891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:45.791917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.792432 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.793136 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:45.793609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:45.940547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:45.950922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:45.953956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-daad7f10-ad99-4d35-b7e0-7e6df6fc3e8c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.189773 Jun 21 03:09:45.953956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 97/199] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:45 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:45.967378 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3cdd2706-2da2-43e4-800c-27cc30bea9a6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.187827 Jun 21 03:09:45.967949 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 103/200] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:45 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:46.015886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:46.016704 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:46.023201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.023695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.024476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.024907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.157015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:46.166001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-deb210a2-9329-4bc9-b560-791ae00312d3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.154286 Jun 21 03:09:46.166572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 98/201] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:46 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:46.305476 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:46.306078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:46.312463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.312907 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.313653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.314076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.400553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:46.401687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:46.415403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.415822 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.416667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.417345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.450021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:46.460368 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:46.463788 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:46.465546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-980e403e-1241-47fc-ace0-145ee478864b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.163950 Jun 21 03:09:46.468204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 104/202] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:46 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:46.591311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:46.601211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f95c4414-be00-4219-b738-b7a12bb26ce2 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.203657 Jun 21 03:09:46.601858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 99/203] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:46 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:46.970816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:46.971593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:46.977960 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.978399 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.979349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.979931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.983785 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:46.984622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:46.991858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.993163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:46.994165 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:46.994526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.150645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.160217 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fcd67abb-243c-478d-8107-a80a16b420c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.180321 Jun 21 03:09:47.162937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 100/204] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:46 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:47.185708 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:47.186983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:47.194262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.195141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.196370 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.197067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.251781 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.262466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-272c9618-d6a8-47c3-82b9-d02aa70fb37c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.295500 Jun 21 03:09:47.263343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 105/205] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:46 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:47.353264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.362132 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-387d96c8-d2db-4cee-8a82-57d56b4134f2 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.180570 Jun 21 03:09:47.364731 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 101/206] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:47 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:47.487461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:47.488735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:47.495693 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.496216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.499486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.499486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.618507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:47.619138 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:47.626587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.627037 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.627893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.628636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.659068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.671851 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.673856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.675493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e14709da-175d-440b-8f4b-d96750ab588a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.193007 Jun 21 03:09:47.676182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 106/207] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:47 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:47.681015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-0b037b84-c62f-4161-b92e-7fc81c26199d req-cb1d0207-950e-45ba-926b-a50befd38a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa1873d-908f-4d20-b5f3-5c6c74ea0294", "name": "network-vif-plugged", "status": "completed", "tag": "b35ccf44-ec65-4aac-bc20-97be5d1a8d07"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:47.690627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-0b037b84-c62f-4161-b92e-7fc81c26199d req-cb1d0207-950e-45ba-926b-a50befd38a2c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:47.691358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-0b037b84-c62f-4161-b92e-7fc81c26199d req-cb1d0207-950e-45ba-926b-a50befd38a2c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:47.707614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-0b037b84-c62f-4161-b92e-7fc81c26199d req-cb1d0207-950e-45ba-926b-a50befd38a2c service nova] Creating event network-vif-plugged:b35ccf44-ec65-4aac-bc20-97be5d1a8d07 for instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 on hv-cinder-84684 Jun 21 03:09:47.716790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-0b037b84-c62f-4161-b92e-7fc81c26199d req-cb1d0207-950e-45ba-926b-a50befd38a2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036796 Jun 21 03:09:47.716790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 107/208] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:47.862145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:47.871260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-eeb634b0-00f0-44f3-9a42-2a9dcc5efc83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.257706 Jun 21 03:09:47.872030 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 102/209] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:47 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:48.177940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:48.178609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:48.185821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.186311 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.187085 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.187519 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.281318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:48.282598 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:48.290239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.290890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.291816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.292381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.361333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:48.380879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7b64c7bc-827e-48b5-90f1-89b63d4ae2d7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.207058 Jun 21 03:09:48.382349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:48 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:48.387026 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:48.387761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:48.395066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.395632 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.396698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.397313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.568562 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:48.582399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ee7887be-659c-4436-98b5-5c6af89fd37b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.304959 Jun 21 03:09:48.583229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 103/211] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:48 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:48.596552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:48.606016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ed994b14-23fd-47be-b25a-4b03803466dd tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.222588 Jun 21 03:09:48.607154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 109/212] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:48 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:48.702625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:48.703511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:48.712929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.713461 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.714285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.714726 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.888946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:48.889557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:48.899679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:48.904153 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.905095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.905420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:48.905852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:48.972999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:48.990417 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:48.993379 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:48.995022 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-08814872-8a68-40cd-aa64-2e28abece1c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.302140 Jun 21 03:09:49.000751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 104/213] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:48 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:49.206468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:49.225821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0e05661d-7584-4f40-be4c-cd345b598ea7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.341040 Jun 21 03:09:49.227715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 110/214] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:48 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:49.398462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:49.399099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:49.413728 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.414222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.416869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.417492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.585305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:49.593911 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-40d5d1e0-05ab-4f19-b3d2-ac81c8f0cf2b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.199950 Jun 21 03:09:49.594997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 105/215] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:49 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:49.607790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:49.608674 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:49.615542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.616185 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.619011 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.619708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.623624 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:49.624443 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:49.631282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.634823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.635631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.636075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.829017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:49.831470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:49.837839 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ea7b2f9-3f76-4407-ac27-4b115b7b5fe8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.242618 Jun 21 03:09:49.839103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 111/216] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:49 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:49.841211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ca559c6a-a3c8-482f-a9cf-98decfffb453 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.221748 Jun 21 03:09:49.850502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 106/217] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:49 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:49.854205 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-cff95ffb-a892-44ce-b091-0dd3cbe7cd28 req-c91c40f7-c335-4902-a469-52b41b2cea6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840c12ba-1c44-43ad-9450-eea9f7b74332", "name": "network-vif-plugged", "status": "completed", "tag": "2f44f583-f139-4fef-81d7-43b8032d3a1a"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:49.865132 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-cff95ffb-a892-44ce-b091-0dd3cbe7cd28 req-c91c40f7-c335-4902-a469-52b41b2cea6d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:49.866198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-cff95ffb-a892-44ce-b091-0dd3cbe7cd28 req-c91c40f7-c335-4902-a469-52b41b2cea6d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:49.879723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-cff95ffb-a892-44ce-b091-0dd3cbe7cd28 req-c91c40f7-c335-4902-a469-52b41b2cea6d service nova] Creating event network-vif-plugged:2f44f583-f139-4fef-81d7-43b8032d3a1a for instance 840c12ba-1c44-43ad-9450-eea9f7b74332 on hv-cinder-84684 Jun 21 03:09:49.885234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-cff95ffb-a892-44ce-b091-0dd3cbe7cd28 req-c91c40f7-c335-4902-a469-52b41b2cea6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044642 Jun 21 03:09:49.886275 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 112/218] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:50.020745 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:50.021774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:50.031184 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.032198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.033301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.034346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.202114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:50.221363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:50.228080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:50.229415 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3c83f60c-fcba-444e-9096-680be6f42144 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.213396 Jun 21 03:09:50.230097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 107/219] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:50 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:50.244607 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:50.245037 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:50.254369 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.255269 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.256232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.257008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.428665 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:50.438368 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-117e3b2a-7587-4912-a695-d10347b4d069 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.198127 Jun 21 03:09:50.438910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 113/220] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:50 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:50.612998 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:50.614380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:50.622440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.623079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.630658 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.631338 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.821226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:50.829798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a128cad8-e1d5-452d-8ba9-2e07c26db490 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1318 microversion: 2.1 time: 0.223280 Jun 21 03:09:50.830838 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 108/221] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:50 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:50.856947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:50.857784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:50.857995 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:50.858969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:50.866737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.869294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.869476 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.870407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.871267 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.871876 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:50.874161 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:50.875372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.091652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:51.104616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:51.109206 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fbd57356-4c88-4db0-a063-f568c2a56802 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.253437 Jun 21 03:09:51.120202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a62bd3fe-a2e4-4d10-ba91-aba5b7f4a5b0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.259773 Jun 21 03:09:51.120202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 109/222] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:50 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:51.125034 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 114/223] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:50 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:51.249066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:51.249676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:51.259542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.260135 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.261837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.262543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.416940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:51.425652 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:51.427151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:51.428259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4fc5f890-d66c-4fb3-9188-7aefa4e7263d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.185125 Jun 21 03:09:51.428847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 110/224] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:51 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:51.455173 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:51.456236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:51.463204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.463900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.464913 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.465544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.614550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:51.624366 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-25beadac-e489-4755-9d5b-9aaf0f171888 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1364 microversion: 2.1 time: 0.173108 Jun 21 03:09:51.625566 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 115/225] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:51 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:51.846838 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:51.848071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:51.854751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.855484 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.856209 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.856926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.906671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-643722a9-95c1-4fb4-8c9c-9776abf28e9a req-add96cf4-ee9b-49cc-93ed-e7320ff4d142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571b42e5-3e2d-4bd4-8e97-5f09fff9b63d", "name": "network-vif-plugged", "status": "completed", "tag": "206224fe-0847-4816-a95b-3775f0529b12"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:51.917588 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-643722a9-95c1-4fb4-8c9c-9776abf28e9a req-add96cf4-ee9b-49cc-93ed-e7320ff4d142 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:51.918507 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-643722a9-95c1-4fb4-8c9c-9776abf28e9a req-add96cf4-ee9b-49cc-93ed-e7320ff4d142 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:51.932343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-643722a9-95c1-4fb4-8c9c-9776abf28e9a req-add96cf4-ee9b-49cc-93ed-e7320ff4d142 service nova] Creating event network-vif-plugged:206224fe-0847-4816-a95b-3775f0529b12 for instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d on hv-cinder-84684 Jun 21 03:09:51.955821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-643722a9-95c1-4fb4-8c9c-9776abf28e9a req-add96cf4-ee9b-49cc-93ed-e7320ff4d142 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049936 Jun 21 03:09:51.957024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 116/226] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:09:52.093238 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:52.102512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dea2750a-3622-4bf0-85f2-f8f83d744513 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1512 microversion: 2.1 time: 0.259536 Jun 21 03:09:52.104051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 111/227] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:51 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:52.127996 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:52.130366 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:52.131953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:52.132534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:52.146336 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.146774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.147573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.147999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.150255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.150729 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.151491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.151939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.249930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lazy-loading 'flavor' on Instance uuid 416a380b-f69e-4101-8c88-d26221caf707 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:09:52.352538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:52.364086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:52.364442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8e6c8a51-0f68-486f-9b5e-9fabd30c3f70 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.238775 Jun 21 03:09:52.366225 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 112/228] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:52 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:52.379879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:52.380978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:52.389059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.389769 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.390808 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.391521 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.414253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:52.429850 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-38ab61b2-c7ff-4aaf-8200-4a62c10cc612 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707/action" status: 200 len: 32 microversion: 2.1 time: 0.311527 Jun 21 03:09:52.430473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 117/229] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:09:52 2022] POST /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:09:52.449003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:52.449711 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:52.457229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.457891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.458571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.459137 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.665917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:52.674584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f4e58ea9-f466-46f3-9bf1-900b09837691 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.306478 Jun 21 03:09:52.675266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 113/230] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:52 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:52.682620 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:52.683466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:52.701554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.702369 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.703823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:52.704404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:52.990254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:52.998709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c465f503-f7ef-4dbf-9346-95d7123a4cd2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.562444 Jun 21 03:09:52.999293 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 118/231] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:52 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:53.004790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:53.005658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:53.014303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.015065 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.016317 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.017003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.191549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:53.199880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:53.201491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:53.202603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ed37c378-911a-4198-ade2-25258cb4d0c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.524554 Jun 21 03:09:53.203163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 114/232] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:52 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:53.243416 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:53.251197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c39f5c3f-345c-4154-b5e8-0c9440163308 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1553 microversion: 2.1 time: 0.250768 Jun 21 03:09:53.251855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 119/233] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:52 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:53.269751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:53.270309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:53.277319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.277941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.279128 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.279752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.383326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:53.384018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:53.391726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.392248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.393197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.393726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.417012 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-706fdaa9-c7ce-4668-9d24-6bbd6aa86311 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151091 Jun 21 03:09:53.424566 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 115/234] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:09:53 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:53.688968 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:09:53.692987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:53.693855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:53.700841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.701646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.703614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:53.704258 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:53.911375 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:53.920488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-26a81ac5-aeb9-40d4-9573-803fa258efb7 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.232162 Jun 21 03:09:53.921386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 116/235] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:53 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:53.958427 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:53.969118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2538eccd-4be8-4947-81ad-57eee28fd83c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.589471 Jun 21 03:09:53.974894 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:53 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:54.017717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:54.018816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:54.039794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.041659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:54.042715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.045355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:54.223008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:54.224190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:54.240137 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.241846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:54.244134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.244835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:54.272697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:54.295649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8e59851c-8418-49b1-8731-12715edfbf01 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.271806 Jun 21 03:09:54.297578 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 117/237] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:54 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:54.751324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:54.759704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:54.761232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:54.762342 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-62e92c48-adfa-45df-8ee9-416418576874 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.545685 Jun 21 03:09:54.762880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 121/238] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:54 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:09:54.938436 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:54.939041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:54.948677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.949118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:54.953511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.953951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:54.991234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:54.991945 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:54.998593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:54.999334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.000425 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.001079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.192756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:55.201645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-08b3de4c-2514-4447-aada-c2fe4955ba9a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.267219 Jun 21 03:09:55.205516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 118/239] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:54 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:55.218528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-9786081a-a5c9-45db-b27e-66c352b078bd req-1727f3b4-2b9b-4731-ab9c-0028f9893794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "name": "network-vif-plugged", "status": "completed", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:55.235188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9786081a-a5c9-45db-b27e-66c352b078bd req-1727f3b4-2b9b-4731-ab9c-0028f9893794 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.235815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9786081a-a5c9-45db-b27e-66c352b078bd req-1727f3b4-2b9b-4731-ab9c-0028f9893794 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.260397 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-9786081a-a5c9-45db-b27e-66c352b078bd req-1727f3b4-2b9b-4731-ab9c-0028f9893794 service nova] Creating event network-vif-plugged:a6a84e7e-f693-4251-bff2-a21fced5ba19 for instance bade48e3-65d3-406d-8d36-53e1f560e554 on hv-cinder-84684 Jun 21 03:09:55.271136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-9786081a-a5c9-45db-b27e-66c352b078bd req-1727f3b4-2b9b-4731-ab9c-0028f9893794 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061048 Jun 21 03:09:55.271802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 119/240] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:55.317604 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:55.318277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:55.326440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.327198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.328219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.329164 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.516756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:55.526044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-17fc3184-7397-46cb-a62b-56ee650a9a29 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.213711 Jun 21 03:09:55.526975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 120/241] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:55 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:55.544452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:55.553017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0678c341-5dcd-4983-b612-b19e65f63393 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1364 microversion: 2.1 time: 0.565755 Jun 21 03:09:55.553881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 122/242] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:54 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1364 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:09:55.712270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-01f95234-e1eb-4111-bd71-614dc3b4aace req-6bb538d8-6aba-4c34-9436-6288d52d1dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc9a9acd-00f9-4181-b4db-70d6ad6930e7", "tag": "dea46eac-9326-474c-8b29-1ce4d2d9cada"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:55.726553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-01f95234-e1eb-4111-bd71-614dc3b4aace req-6bb538d8-6aba-4c34-9436-6288d52d1dfb service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.726995 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-01f95234-e1eb-4111-bd71-614dc3b4aace req-6bb538d8-6aba-4c34-9436-6288d52d1dfb service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.745102 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-01f95234-e1eb-4111-bd71-614dc3b4aace req-6bb538d8-6aba-4c34-9436-6288d52d1dfb service nova] Creating event network-changed:dea46eac-9326-474c-8b29-1ce4d2d9cada for instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 on hv-cinder-84684 Jun 21 03:09:55.752605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-01f95234-e1eb-4111-bd71-614dc3b4aace req-6bb538d8-6aba-4c34-9436-6288d52d1dfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043810 Jun 21 03:09:55.753939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 121/243] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:55.782173 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:55.782785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:55.788911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.789353 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.790196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:55.790526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:55.946232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:55.961964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:55.964111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:55.966772 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e7710955-38bf-4402-8c28-753d018156ae tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.190092 Jun 21 03:09:55.967889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 123/244] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:55 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:56.222891 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:56.223939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:56.230991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.231998 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.233110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.233820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.403586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:56.411186 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-418a6838-43e1-428d-b758-34e5fd3169ee tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.193203 Jun 21 03:09:56.411758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 122/245] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:56 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:56.544615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:56.545362 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:56.571591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:56.572355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:56.577906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.578851 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.583413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.584179 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.585113 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.586429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.590046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.591894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.821269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:56.831383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9893c29b-389a-424e-bb78-9157267c310b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1547 microversion: 2.1 time: 0.264090 Jun 21 03:09:56.834044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 123/246] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:56 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1547 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:56.856926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:56.862160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:56.869494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.869980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.870739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:56.871489 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:56.880886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:56.894015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a75ccdc3-b90c-4be1-b3ce-d575be5592c6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.353496 Jun 21 03:09:56.905089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 124/247] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:56 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:56.968207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-562e5ab7-46b0-491a-9c13-da545c8c59f6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120157 Jun 21 03:09:56.968918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 124/248] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:09:56 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:56.987011 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:56.990277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:57.004038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:57.004728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:57.006643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:57.007248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:57.358740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:57.370013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:57.372891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:57.374383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3350883d-d96e-4ccc-acd6-fc8b836ae243 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.393420 Jun 21 03:09:57.375351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 125/249] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:56 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:57.429741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:57.431545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:57.451582 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:57.452190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:57.453473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:57.454699 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:57.660708 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:57.673530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ff250c54-7f62-4542-b9ef-6f11cca77af0 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1314 microversion: 2.1 time: 0.248667 Jun 21 03:09:57.676841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 125/250] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:57 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:57.912840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:57.913471 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:57.919344 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:57.920102 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:57.920882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:57.921310 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:58.253128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:58.262012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7432287c-f61f-437f-938b-6e786e10e5d0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.353262 Jun 21 03:09:58.262609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 126/251] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:57 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:58.392088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:58.392739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:58.398952 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:58.399420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:58.400174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:58.400630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:58.582936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-454e11b8-2b98-4711-a554-4990c73ca631 req-e4658e7f-7898-4e5e-9a51-a1d3fd48dd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c12ba-1c44-43ad-9450-eea9f7b74332", "tag": "2f44f583-f139-4fef-81d7-43b8032d3a1a"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:09:58.622937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-454e11b8-2b98-4711-a554-4990c73ca631 req-e4658e7f-7898-4e5e-9a51-a1d3fd48dd20 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:58.624690 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-454e11b8-2b98-4711-a554-4990c73ca631 req-e4658e7f-7898-4e5e-9a51-a1d3fd48dd20 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:58.642859 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:58.654593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-454e11b8-2b98-4711-a554-4990c73ca631 req-e4658e7f-7898-4e5e-9a51-a1d3fd48dd20 service nova] Creating event network-changed:2f44f583-f139-4fef-81d7-43b8032d3a1a for instance 840c12ba-1c44-43ad-9450-eea9f7b74332 on hv-cinder-84684 Jun 21 03:09:58.662678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:58.666473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-454e11b8-2b98-4711-a554-4990c73ca631 req-e4658e7f-7898-4e5e-9a51-a1d3fd48dd20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105152 Jun 21 03:09:58.669320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:58.671629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 127/252] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:09:58.673460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3ce3deb8-4f54-43e4-9091-a4e9deb5dbac tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.285156 Jun 21 03:09:58.673957 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 126/253] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:58 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:09:58.697543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:58.698771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:58.718151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:58.719031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:58.720276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:58.720972 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:58.974036 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:58.984428 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9ec61166-b7ac-4bed-91c8-e207084a4730 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1502 microversion: 2.1 time: 0.293374 Jun 21 03:09:58.985522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 128/254] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:58 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:59.282845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:59.283837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:59.292877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:59.293575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:59.294974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:59.295664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:59.516376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:59.524150 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fa7af34b-2796-45e7-90f7-7e80c4d8e01c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.248117 Jun 21 03:09:59.524738 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 127/255] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:09:59 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:09:59.703817 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:09:59.704553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:09:59.711149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:59.711689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:59.712775 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:09:59.713372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:09:59.877724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:59.885917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:59.887832 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:09:59.888971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-44b49a49-0664-4384-9671-3a2bba7f4566 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1407 microversion: 2.20 time: 0.200731 Jun 21 03:09:59.892469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 129/256] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:09:59 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:10:00.541362 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:00.543297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:00.549674 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:00.550188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:00.550949 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:00.551403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:00.748991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:00.759038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-66bd418c-778b-4aa6-ba38-08f544789b08 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.221508 Jun 21 03:10:00.760762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 128/257] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:00 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:00.908897 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:00.909611 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:00.920819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:00.920819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:00.923724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:00.924171 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.245031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:01.267227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:01.268819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:01.270094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d7592e4-77b5-4a39-be2d-6ad845803b68 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1599 microversion: 2.20 time: 0.366562 Jun 21 03:10:01.270642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 130/258] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:10:00 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1599 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:10:01.290967 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:01.291902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:01.299879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:01.300647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.301812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:01.302282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.390365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f6842ac8-9692-4bd6-bc3d-7579e65e5d73 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106405 Jun 21 03:10:01.392314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 129/259] 10.222.0.16 () {60 vars in 1315 bytes} [Tue Jun 21 03:10:01 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:10:01.516778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed517fba-8fcd-4810-b479-e37c708d70bf"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:01.517905 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:01.525194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:01.526129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.527049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:01.527972 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.775148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:01.775797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:01.782724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:01.783527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.785016 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:01.785475 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:01.920861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-507d33b3-5768-4d01-b816-2718e23cc027 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "POST /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407980 Jun 21 03:10:01.927374 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 131/260] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:10:01 2022] POST /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:01.951782 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:01.960329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5a280ce1-1d48-4754-8039-895732861d89 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.189007 Jun 21 03:10:01.961098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 130/261] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:01 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:02.844245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-950adbaa-4f02-46ec-90a4-42a544370129 req-e633fff6-20c4-4068-8bd0-c289b27d0167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:02.868778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-950adbaa-4f02-46ec-90a4-42a544370129 req-e633fff6-20c4-4068-8bd0-c289b27d0167 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:02.869219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-950adbaa-4f02-46ec-90a4-42a544370129 req-e633fff6-20c4-4068-8bd0-c289b27d0167 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:02.880955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-950adbaa-4f02-46ec-90a4-42a544370129 req-e633fff6-20c4-4068-8bd0-c289b27d0167 service nova] Creating event network-changed:a6a84e7e-f693-4251-bff2-a21fced5ba19 for instance bade48e3-65d3-406d-8d36-53e1f560e554 on hv-cinder-84684 Jun 21 03:10:02.886278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-950adbaa-4f02-46ec-90a4-42a544370129 req-e633fff6-20c4-4068-8bd0-c289b27d0167 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046509 Jun 21 03:10:02.886866 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 132/262] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:02.983025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:02.984848 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:02.998342 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:02.999202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:02.999964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:03.000581 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:03.157266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:03.171703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c2899c83-832c-4dc1-8fd8-07852b63dcb8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.197621 Jun 21 03:10:03.172288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 131/263] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:02 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:04.190210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:04.190913 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:04.197322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:04.197678 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:04.198615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:04.199249 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:04.441706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:04.446145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:04.452065 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9d1f1ad2-95a4-4d15-a78d-cb830e7f7af3 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.266480 Jun 21 03:10:04.453472 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 133/264] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:04 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:05.470964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:05.471804 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:05.479889 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:05.480529 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:05.481293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:05.481874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:05.501465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:05.616492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:05.624257 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f028c163-519d-4bee-8d71-dd2af1ed329a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.157390 Jun 21 03:10:05.624821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 132/265] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:05 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:06.648182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:06.648973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:06.660552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:06.661055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:06.661814 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:06.664160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:06.806142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:06.814221 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d76dc9ee-57ff-4554-a1d1-323528d8bb86 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.175670 Jun 21 03:10:06.814779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 134/266] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:06 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:07.830520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:07.831361 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:07.837470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:07.837910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:07.838667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:07.839089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:07.973340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:07.981778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-eb89adc9-95c3-4a92-a8cf-d0e13616bc84 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.155050 Jun 21 03:10:07.982559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 133/267] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:07 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:08.999145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:08.999943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:09.007363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:09.007728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:09.008507 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:09.008930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:09.178925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:09.187469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-94a2fce8-b163-4036-a2a1-c5edba0300bc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.192331 Jun 21 03:10:09.188674 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 135/268] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:08 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:10.205031 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:10.205689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:10.207752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=99 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:10.213024 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:10.213572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:10.214432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:10.214895 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:10.367909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:10.377089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-de6ecd43-ec95-488d-ac4a-4c38dc6f0c6d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.175999 Jun 21 03:10:10.378415 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 134/269] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:10 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:11.395326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:11.396083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:11.404606 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:11.406095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:11.406095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:11.406590 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:11.720989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:11.733322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-67151824-2948-42b4-a745-b668c45a8132 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.341481 Jun 21 03:10:11.755067 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 136/270] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:11 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:12.741775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:12.742335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:12.748953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:12.749393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:12.750144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:12.750572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:12.751475 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:12.752088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:12.759226 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:12.759669 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:12.760707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:12.761143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:12.777561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:10:12.887367 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0257ae4b-90e8-4a46-bdb2-2d71afd38fd4 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 204 len: 0 microversion: 2.1 time: 0.149160 Jun 21 03:10:12.889467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 135/271] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:10:12 2022] DELETE /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:10:12.900325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:12.901048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:12.907310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:12.907748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:12.908545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:12.909032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:13.006077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:13.014983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a2bc70c6-eb2a-499d-a974-cab4e80c80ce tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.267601 Jun 21 03:10:13.016043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 137/272] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:12 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:13.059722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:13.069236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-efe28a23-00a8-4c4f-ac63-7742b19adf26 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.173084 Jun 21 03:10:13.070225 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 136/273] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:12 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:14.032997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:14.033712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:14.045437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:14.045938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:14.046812 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:14.047224 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:14.087117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:14.087843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:14.101405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:14.101988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:14.105328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:14.106131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:14.402513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:14.413386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e16560d1-58f9-4611-9058-c2e6dffc70b9 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.330277 Jun 21 03:10:14.422958 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 137/274] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:14 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:14.520565 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:14.529049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3dc413ee-0d56-4ca1-b9ec-a34c05ea18a1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.500015 Jun 21 03:10:14.529618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 138/275] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:14 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:15.431112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:15.431803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:15.437772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:15.438208 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:15.438950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:15.439380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:15.547470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:15.548744 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:15.555279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:15.555724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:15.556516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:15.556953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:15.573647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:15.582926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6350a0c4-3f07-43f6-bb40-4c3c4c4f99b6 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.155721 Jun 21 03:10:15.583506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 138/276] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:15 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:15.757782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:15.768919 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-37f60e71-0a4b-4b59-a872-9c4f2e0221b1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.225687 Jun 21 03:10:15.770443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 139/277] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:15 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:16.600921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:16.601527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:16.607785 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:16.608437 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:16.609192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:16.609763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:16.787333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:16.787999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:16.795670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:16.796478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:16.797462 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:16.798198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:16.991188 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:17.011930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7d6d2e51-ce50-42d5-9b4c-5ffc46962e32 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.228346 Jun 21 03:10:17.014224 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 140/278] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:16 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:17.053169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:17.062461 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0498a6f9-74fa-4994-b040-b7d958dfd645 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.465891 Jun 21 03:10:17.063180 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 139/279] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:16 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:18.040862 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:18.041976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:18.052510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:18.053204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:18.054304 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:18.054906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:18.078985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:18.080289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:18.091092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:18.091657 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:18.093287 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:18.100936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:18.350278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:18.361048 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2544f02b-d65d-446c-8476-3817e1ddf327 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.333959 Jun 21 03:10:18.362568 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 141/280] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:18 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:18.391773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:18.408608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e0470e3b-4a07-4661-94a4-11ec67ceb86b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.333168 Jun 21 03:10:18.414372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 140/281] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:18 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:19.381130 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:19.381921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:19.387371 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=63 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:19.400396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:19.400964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:19.401821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:19.402481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:19.434440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:19.438864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:19.458676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:19.459484 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:19.460716 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:19.461321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:19.623943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:19.633977 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c01e36cd-0180-493c-9a57-211d14b54cfc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.258040 Jun 21 03:10:19.635503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 142/282] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:19 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:19.693503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:19.705147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b5d7b35b-09cb-4c3a-b92e-125d547a37c3 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.278930 Jun 21 03:10:19.725769 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 141/283] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:19 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:20.661579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:20.662351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:20.672804 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:20.673626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:20.674651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:20.675286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:20.724243 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:20.727535 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:20.742082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:20.742531 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:20.743289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:20.743810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:20.906749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:20.914576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2315feeb-3023-4a6a-b095-8d715ffe9e77 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.261173 Jun 21 03:10:20.915168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 143/284] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:20 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:20.918984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:20.933250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7709527c-364c-45eb-818d-4f2e679f1e8e tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.212415 Jun 21 03:10:20.943332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 142/285] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:20 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:21.232061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ed90fb3-6945-4f88-8811-df8f5a949651 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Action: 'create', calling method: .version_select at 0x7fe79a436790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1782746954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE11bSZRcZ67KOZslFbw538y1MV3vxtUIJyUurOiM4chP3KKId72sb+9bIBJ7e3KCe56eF/Fa5g/7S1g5mZe1iTQ+LttBFtuJH+2Tz7QBbgGFrs376nEqlcKPFKvArj6Xw=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:21.246824 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-7ed90fb3-6945-4f88-8811-df8f5a949651 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for project 1a43462c60384cecb441ccf14de5672e. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:10:21.251035 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-7ed90fb3-6945-4f88-8811-df8f5a949651 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for user 41c4d3bab2164767b8eefcb4427b65b7 and project 1a43462c60384cecb441ccf14de5672e. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:10:21.274726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ed90fb3-6945-4f88-8811-df8f5a949651 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.234066 Jun 21 03:10:21.275280 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 144/286] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:10:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:10:21.932158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:21.933328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:21.939853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:21.940313 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:21.941189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:21.941613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:21.954765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:21.956686 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:21.971878 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:21.972442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:21.973314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:21.973837 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:22.144357 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:22.155801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-34cf00d9-6c19-43da-8b00-a02b4c2938a8 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.208724 Jun 21 03:10:22.156372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 145/287] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:21 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:22.173046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:22.182341 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7f2960bc-1fdf-475a-aeec-449524f5fe36 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.254009 Jun 21 03:10:22.182906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 143/288] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:21 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:23.172920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:23.173524 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:23.180707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:23.181169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:23.181927 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:23.182355 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:23.199059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:23.199660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:23.205839 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:23.206293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:23.207145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:23.207576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:23.391066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:23.392972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:23.400055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c212d9ba-a68b-4d16-a6d0-55461159db47 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.230978 Jun 21 03:10:23.400660 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 146/289] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:23 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:23.402806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9b20bef4-b0cd-46b6-bab4-f97fd0adf070 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.207413 Jun 21 03:10:23.403365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 144/290] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:23 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:24.421517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:24.422147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:24.425726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:24.426352 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:24.435306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:24.435790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:24.438637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:24.438637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:24.440450 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:24.441131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:24.441909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:24.442345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:24.576485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:24.580765 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:24.584613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b095cd65-d29b-48dd-a858-8753048ffb45 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.171071 Jun 21 03:10:24.585184 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 147/291] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:24 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:24.588521 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7c015c42-45d4-465a-99f3-d95cdc8c7a1e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.170967 Jun 21 03:10:24.589072 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 145/292] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:24 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:25.602436 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:25.603046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:25.606932 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:25.607547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:25.611441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:25.612313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:25.613344 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:25.613737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:25.614091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:25.614544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:25.615337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:25.615951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:25.770238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:25.779976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9557c4a3-3778-4d9a-a739-92baf7ad8175 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.181754 Jun 21 03:10:25.781257 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 148/293] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:25 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:25.787155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:25.802947 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7c6b7b95-2825-47e6-a89e-497739b2983f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.199853 Jun 21 03:10:25.803787 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 146/294] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:25 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:26.798291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:26.798987 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:26.807665 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:26.808169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:26.809089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:26.809552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:26.821104 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:26.821748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:26.829358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:26.829799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:26.831061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:26.831692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:26.852825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:26.968226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:26.978052 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3c0c9cca-923a-469c-a313-47a0fce50551 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.160954 Jun 21 03:10:26.978687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 147/295] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:26 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:27.064316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:27.073339 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-33fd2868-ab6e-463c-8a9c-e88746b17e4b tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1554 microversion: 2.1 time: 0.279394 Jun 21 03:10:27.074042 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:26 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:27.236267 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-9e7a0dd6-8688-48a6-9458-0e272d2fa646 req-37a96e4c-b5a6-4aeb-b2f5-dc14746c8ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571b42e5-3e2d-4bd4-8e97-5f09fff9b63d", "name": "network-vif-deleted", "tag": "206224fe-0847-4816-a95b-3775f0529b12"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:27.250173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9e7a0dd6-8688-48a6-9458-0e272d2fa646 req-37a96e4c-b5a6-4aeb-b2f5-dc14746c8ba2 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:27.251013 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9e7a0dd6-8688-48a6-9458-0e272d2fa646 req-37a96e4c-b5a6-4aeb-b2f5-dc14746c8ba2 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:27.270872 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-9e7a0dd6-8688-48a6-9458-0e272d2fa646 req-37a96e4c-b5a6-4aeb-b2f5-dc14746c8ba2 service nova] Creating event network-vif-deleted:206224fe-0847-4816-a95b-3775f0529b12 for instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d on hv-cinder-84684 Jun 21 03:10:27.276345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-9e7a0dd6-8688-48a6-9458-0e272d2fa646 req-37a96e4c-b5a6-4aeb-b2f5-dc14746c8ba2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043812 Jun 21 03:10:27.276976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 148/297] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:27.995186 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:27.995798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:28.003798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:28.004328 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:28.005064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:28.005487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:28.091442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:28.092114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:28.100848 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:28.101733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:28.102834 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:28.103361 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:28.139498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:28.139939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:28.140527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lazy-loading 'fault' on Instance uuid 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:10:28.156861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:28.170001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7c102dbe-cc03-4a56-9583-6043b8cd707a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.178659 Jun 21 03:10:28.170576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 150/298] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:27 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:28.205566 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae9f551626460e864561c613d5f273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c102f5ee47e426c8f4e0ced15f60bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:28.216528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0c75190c-83d5-4c20-b892-b12ae0ed6e5c tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 200 len: 1350 microversion: 2.1 time: 0.129417 Jun 21 03:10:28.217095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 149/299] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:28 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 1350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:29.189641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:29.191083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:29.203039 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:29.204937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:29.206180 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:29.206796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:29.233891 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:29.234608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:29.242565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:29.243002 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:29.243892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:29.244602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:29.255289 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:29.262533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] HTTP exception thrown: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Request method failure captured: Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d HTTP/1.1 Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZErX_LmGOpuvLXkNrkiIFyvmPvmsXEYZUCm1cUUC8LjYge_-4vzut8yzP4mwCEIoLzDuFL82LAC0QYFJ6mNonBA0EguQnSWT6AUIPE5oI-SEOnMkk8ubpvp8eB9D8s73JjaZPyLnKDjNyOJCuE7f1z8xcWztxkaAyVLgEBcEodmkI Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:10:29.270457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c102f5ee47e426c8f4e0ced15f60bee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: e3ae9f551626460e864561c613d5f273 Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.272365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '571b42e5-3e2d-4bd4-8e97-5f09fff9b63d'} Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:10:29.273320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.274617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.277837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Returning 404 to user: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:10:29.278960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8c5c8639-c58f-4c03-92a1-6af716d01c23 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 404 len: 111 microversion: 2.1 time: 0.049018 Jun 21 03:10:29.279538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 150/300] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:29 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:10:29.415758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:29.416991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:29.425253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:29.425701 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:29.426465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:29.430767 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:29.443376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:29.446403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] HTTP exception thrown: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Request method failure captured: Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d/os-volume_attachments HTTP/1.1 Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZErX_LmGOpuvLXkNrkiIFyvmPvmsXEYZUCm1cUUC8LjYge_-4vzut8yzP4mwCEIoLzDuFL82LAC0QYFJ6mNonBA0EguQnSWT6AUIPE5oI-SEOnMkk8ubpvp8eB9D8s73JjaZPyLnKDjNyOJCuE7f1z8xcWztxkaAyVLgEBcEodmkI Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:10:29.449579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c102f5ee47e426c8f4e0ced15f60bee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: e3ae9f551626460e864561c613d5f273 Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.450743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'server_id': '571b42e5-3e2d-4bd4-8e97-5f09fff9b63d'} Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:10:29.451434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:29.452561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:10:29.453671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6eb83e72-8bae-4ae2-9319-909e56018966 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.270075 Jun 21 03:10:29.454250 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 151/301] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:29 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:29.455428 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Returning 404 to user: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:10:29.456538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4703e6f9-bc44-4058-b333-8d969dde1a28 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044935 Jun 21 03:10:29.457073 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 151/302] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:10:29 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:10:30.471815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:30.472503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:30.480201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:30.480873 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:30.482462 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:30.483660 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:30.623184 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:30.631869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7f48c66b-3f40-4f69-b78c-7bd5afe79d16 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.164181 Jun 21 03:10:30.632454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 152/303] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:30 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:31.649702 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:31.650281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:31.656628 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:31.657066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:31.657798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:31.658211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:31.724182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:31.725440 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:31.728672 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:31.732762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:31.733211 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:31.733983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:31.734409 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:31.758003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] HTTP exception thrown: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Request method failure captured: Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d HTTP/1.1 Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZErX_LmGOpuvLXkNrkiIFyvmPvmsXEYZUCm1cUUC8LjYge_-4vzut8yzP4mwCEIoLzDuFL82LAC0QYFJ6mNonBA0EguQnSWT6AUIPE5oI-SEOnMkk8ubpvp8eB9D8s73JjaZPyLnKDjNyOJCuE7f1z8xcWztxkaAyVLgEBcEodmkI Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:10:31.763004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c102f5ee47e426c8f4e0ced15f60bee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: e3ae9f551626460e864561c613d5f273 Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.764337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '571b42e5-3e2d-4bd4-8e97-5f09fff9b63d'} Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:10:31.765046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.766089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.767160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Returning 404 to user: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:10:31.767160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0caf9433-4411-45f8-a1ea-161ec88e5290 tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 404 len: 111 microversion: 2.1 time: 0.044918 Jun 21 03:10:31.767160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 153/304] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:10:31 2022] DELETE /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:10:31.773435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:31.774147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] [instance: 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:31.780685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:31.781146 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:31.781941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:31.782376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:31.796651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] HTTP exception thrown: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Request method failure captured: Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d HTTP/1.1 Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZErX_LmGOpuvLXkNrkiIFyvmPvmsXEYZUCm1cUUC8LjYge_-4vzut8yzP4mwCEIoLzDuFL82LAC0QYFJ6mNonBA0EguQnSWT6AUIPE5oI-SEOnMkk8ubpvp8eB9D8s73JjaZPyLnKDjNyOJCuE7f1z8xcWztxkaAyVLgEBcEodmkI Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:10:31.798170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c102f5ee47e426c8f4e0ced15f60bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c102f5ee47e426c8f4e0ced15f60bee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 8c102f5ee47e426c8f4e0ced15f60bee Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-DeleteServersTestJSON-532324466 Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: e3ae9f551626460e864561c613d5f273 Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-DeleteServersTestJSON-532324466-project Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.799799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '571b42e5-3e2d-4bd4-8e97-5f09fff9b63d'} Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:10:31.800493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. Jun 21 03:10:31.801818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:31.802939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] Returning 404 to user: Instance 571b42e5-3e2d-4bd4-8e97-5f09fff9b63d could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:10:31.802939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3791ea08-b3a1-42f1-8b55-4b1a891bce4a tempest-DeleteServersTestJSON-532324466 tempest-DeleteServersTestJSON-532324466-project] 10.222.0.16 "GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d" status: 404 len: 111 microversion: 2.1 time: 0.029940 Jun 21 03:10:31.803081 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:31.803178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 154/305] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:31 2022] GET /compute/v2.1/servers/571b42e5-3e2d-4bd4-8e97-5f09fff9b63d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:10:31.808028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3cde3d42-0f8d-4057-8bff-e6280df2b3e0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.162070 Jun 21 03:10:31.808823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 152/306] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:31 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:32.825218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:32.825887 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:32.832893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:32.833414 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:32.834234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:32.834736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:33.037648 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:33.045963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c37c2c30-b04a-4601-bfe9-911c9aef2451 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.224339 Jun 21 03:10:33.046576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 155/307] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:32 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:34.063050 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:34.063642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:34.074703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:34.075641 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:34.077297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:34.078089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:34.233471 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:34.241604 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c6dd574c-b386-443b-ac4e-35a9fbfdeff1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.182339 Jun 21 03:10:34.242175 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 153/308] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:34 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:35.259834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:35.260454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:35.269240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:35.269696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:35.270488 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:35.270917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:35.405592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:35.413087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-921d1d4b-b612-49f8-b684-5072a60f57f1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.157726 Jun 21 03:10:35.413655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 156/309] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:35 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:36.430982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:36.431636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:36.438040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:36.438494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:36.439250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:36.440296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:36.579317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:36.586882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2ac06a88-aff0-4512-89dc-4f37a83b69e2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.159745 Jun 21 03:10:36.587426 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 154/310] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:36 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:36.762080 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-17d23e0d-8096-43de-8ceb-5a0d35d9f728 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Action: 'create', calling method: .version_select at 0x7fe79a33ed30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1764198197", "metadata": {"Type": "work"}}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:37.078004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-17d23e0d-8096-43de-8ceb-5a0d35d9f728 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.453736 Jun 21 03:10:37.079081 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 157/311] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jun 21 03:10:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 455 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 03:10:37.089853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-29f69bd0-3c47-4495-9934-2407fbaa2b97 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a3889d0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:37.152187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-29f69bd0-3c47-4495-9934-2407fbaa2b97 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 200 len: 353 microversion: 2.1 time: 0.060410 Jun 21 03:10:37.152187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 155/312] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:37 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:10:37.603333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:37.603752 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:37.610635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:37.611079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:37.611841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:37.612294 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:37.754097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:37.765485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dd35e7cc-d882-4a22-bcde-efe06c003e06 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.165963 Jun 21 03:10:37.766082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 158/313] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:37 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:38.163761 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-00a86e98-a914-4d07-ba7b-a9464c096153 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a388160>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:38.215086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-00a86e98-a914-4d07-ba7b-a9464c096153 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 200 len: 353 microversion: 2.1 time: 0.056704 Jun 21 03:10:38.215622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 156/314] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:38 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:38.786642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:38.787441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:38.797502 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:38.798202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:38.799468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:38.799762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:38.939842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:38.947634 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e52dcfed-a141-432e-8f6e-c0d2e4c51c0b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.167373 Jun 21 03:10:38.948199 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 159/315] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:38 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:39.228087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6111b521-4b6f-4512-8edd-ed27f161d050 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a4b25e0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:39.286172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6111b521-4b6f-4512-8edd-ed27f161d050 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 200 len: 353 microversion: 2.1 time: 0.061960 Jun 21 03:10:39.286923 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:39 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:39.965222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:39.965831 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:39.975129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:39.976036 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:39.977187 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:39.978029 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:40.130841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:40.138920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8c5a0541-c0aa-48b4-a3d4-e60b0053e177 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.177595 Jun 21 03:10:40.139478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 160/317] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:39 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:40.301040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e4f58429-8276-408b-8881-f13ce1e69b18 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a373ee0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:40.352618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e4f58429-8276-408b-8881-f13ce1e69b18 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 200 len: 354 microversion: 2.1 time: 0.056809 Jun 21 03:10:40.353214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 158/318] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:40 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:40.364734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-617475df-fe33-4147-ad08-6be060be0406 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a33f700>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:40.415437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-617475df-fe33-4147-ad08-6be060be0406 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 200 len: 354 microversion: 2.1 time: 0.055068 Jun 21 03:10:40.416011 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 161/319] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:40 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:40.432122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fdce4d5f-d0c9-4394-8308-c8be1a8496a4 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a65d0d0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:40.504387 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fdce4d5f-d0c9-4394-8308-c8be1a8496a4 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 202 len: 0 microversion: 2.1 time: 0.075932 Jun 21 03:10:40.505208 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 159/320] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:10:40 2022] DELETE /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:10:40.526014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-72a1e719-5d07-41c6-af50-51afc581d797 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a33eca0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:40.596486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-72a1e719-5d07-41c6-af50-51afc581d797 tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 200 len: 353 microversion: 2.1 time: 0.087017 Jun 21 03:10:40.597137 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 162/321] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:40 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:10:41.156797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:41.157395 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:41.159393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:41.164988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:41.165429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:41.166194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:41.166982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:41.314650 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:41.326105 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-50a58da5-794b-49e6-95f7-94d98e43a323 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.173306 Jun 21 03:10:41.326666 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 160/322] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:41 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:41.609647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4317491-8952-43f0-aab4-e7641296635e tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Calling method '.version_select at 0x7fe79a33b670>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:41.642012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-f4317491-8952-43f0-aab4-e7641296635e tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] HTTP exception thrown: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4317491-8952-43f0-aab4-e7641296635e tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Request method failure captured: Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb HTTP/1.1 Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTasV4kQZlpPzLl_PLCzxhScsqVNNTDVKNW4koF-j_0yey-TENFaKCI5EFmtAP0KS0r521XWG0Dhi6Mp8rXicj0HXxntiWxq3Q-XO1rOAZcBFMhQh0Vu_qFyHAd0rpaLTdlmfT4t-Q1YSdpCEfHBuYDVlIx2BbyCsqe_CYoJ3zXg0RM Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: e986ed3e936e47bb8c4ac70fb24bb8ef Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesGetTestJSON-742849764 Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:10:41.646490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e986ed3e936e47bb8c4ac70fb24bb8ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e986ed3e936e47bb8c4ac70fb24bb8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e986ed3e936e47bb8c4ac70fb24bb8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e986ed3e936e47bb8c4ac70fb24bb8ef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesGetTestJSON-742849764 Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: e986ed3e936e47bb8c4ac70fb24bb8ef Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesGetTestJSON-742849764 Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesGetTestJSON-742849764-project Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 81fa4d4cc93340c1a1d38828e027a5b5 Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesGetTestJSON-742849764-project Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '5b2527d4-b277-4c7f-9071-0afb75e63edb'} Jun 21 03:10:41.647989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. (HTTP 404) (Request-ID: req-b11db69e-54a4-4fd6-8b7e-3bcc79397ee8) Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:41.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:10:41.650303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 03:10:41.651910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4317491-8952-43f0-aab4-e7641296635e tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] Returning 404 to user: Volume 5b2527d4-b277-4c7f-9071-0afb75e63edb could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f4317491-8952-43f0-aab4-e7641296635e tempest-VolumesGetTestJSON-742849764 tempest-VolumesGetTestJSON-742849764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb" status: 404 len: 109 microversion: 2.1 time: 0.044193 Jun 21 03:10:41.652999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 163/323] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:10:41 2022] GET /compute/v2.1/os-volumes/5b2527d4-b277-4c7f-9071-0afb75e63edb => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:10:42.344131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:42.344756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:42.355490 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:42.355975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:42.360024 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:42.362485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:42.508746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:42.517369 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1de67d1f-1ff4-4ebd-9684-5c81e85330cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1518 microversion: 2.1 time: 0.177641 Jun 21 03:10:42.526346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 161/324] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:42 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:43.544069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:43.544069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:43.544069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:43.544745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:43.545474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:43.546027 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:43.697326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:43.704900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ea7571a-d5dc-4b52-8b94-0483507be0f2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1498 microversion: 2.1 time: 0.174438 Jun 21 03:10:43.705456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 164/325] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:43 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:43.721064 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:43.721794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:43.728643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:43.729093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:43.729866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:43.730300 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:43.878832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:43.889349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-69eaf85b-3b01-4ec1-a8bd-7baf115cd428 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1516 microversion: 2.1 time: 0.172089 Jun 21 03:10:43.890912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 162/326] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:43 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:45.386094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:45.387102 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:45.394443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:45.394917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:45.395660 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:45.396165 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:45.420476 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lazy-loading 'flavor' on Instance uuid aaa1873d-908f-4d20-b5f3-5c6c74ea0294 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:10:45.526450 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-78a0d5a7-01da-4249-ada4-c5e125505d0e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/action" status: 200 len: 32 microversion: 2.1 time: 0.144619 Jun 21 03:10:45.528110 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 165/327] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:10:45 2022] POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:10:45.537315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:45.538684 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:45.547230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:45.547778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:45.550592 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:45.553994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:45.773783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:45.784293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d9052e54-f1dd-4cf1-91b9-b9dee7a4302a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.250812 Jun 21 03:10:45.785733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 163/328] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:45 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:46.802736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:46.803471 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:46.810671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:46.811650 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:46.812802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:46.813246 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:46.964273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:46.972635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-11f096f4-aefe-4eca-8f57-830e4d1886b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.174004 Jun 21 03:10:46.973348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 166/329] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:46 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:47.991115 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:47.991721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:47.999542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:48.000348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:48.001394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:48.002506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:48.162682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:48.170503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d8aabb76-a80e-4208-a201-c857a8cfe516 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.183260 Jun 21 03:10:48.171055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 164/330] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:47 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:49.188621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:49.189266 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:49.195912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:49.196375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:49.197279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:49.197714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:49.343735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:49.354743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a73542b9-2b80-4922-8549-90ba71ef021d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.170835 Jun 21 03:10:49.355322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 167/331] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:49 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:49.543131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1295787819", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "networks": [{"uuid": "f2abf431-f273-437a-aebe-28a3974ec06c"}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:49.594990 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] validate_networks() for [('f2abf431-f273-437a-aebe-28a3974ec06c', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:10:49.958749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:10:49.959195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:10:49.959774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:10:49.960263 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:10:49.960746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:10:49.971522 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:49.971971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:49.972802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:49.973236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:49.990825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Getting quotas for project 0d8e2178a3c84520ac00fc1cf2da0329. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:10:49.995149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Getting quotas for user 4d0e5c4a49d84ab9ab4c2db7d09e6fac and project 0d8e2178a3c84520ac00fc1cf2da0329. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:10:50.007922 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:10:50.010485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:10:50.057945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9192afad-fda9-43ad-a075-4a6d7796e31e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518697 Jun 21 03:10:50.058747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 165/332] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:10:50.068731 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b91a25f8-f493-4a92-a9ca-3dc645558554 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:50.069465 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b91a25f8-f493-4a92-a9ca-3dc645558554 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:50.072954 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:50.127420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b91a25f8-f493-4a92-a9ca-3dc645558554 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:50.137363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b91a25f8-f493-4a92-a9ca-3dc645558554 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1219 microversion: 2.1 time: 0.072561 Jun 21 03:10:50.138148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 168/333] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:50 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:50.372555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:50.373149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:50.381149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:50.381597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:50.382449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:50.382882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:50.720109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:50.729372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-557b94d1-f616-4502-9d54-57ad88e3133b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.361024 Jun 21 03:10:50.729931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 166/334] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:50 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:51.154537 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:51.155147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:51.175373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:51.175925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:51.177167 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:51.177669 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:51.286504 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:51.297423 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bddcc9f8-556b-4ede-b1e7-e2d567108731 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1279 microversion: 2.1 time: 0.146714 Jun 21 03:10:51.298356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 169/335] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:51 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:51.748381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:51.749170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:51.755979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:51.756750 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:51.757799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:51.758435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:51.908920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:51.916788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d3f5f005-1646-465a-beb1-095b3be4bd66 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.173534 Jun 21 03:10:51.917612 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 167/336] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:51 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:52.314697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:52.315370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:52.322017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:52.322542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:52.323640 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:52.324434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:52.528636 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:52.539703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0e5df264-914f-4f1f-9b3b-238dfa136d9b tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.229279 Jun 21 03:10:52.540933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 170/337] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:52 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:52.639923 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-e29923de-779b-4eee-a434-04289eafa9bc req-44b20073-ff8a-42f0-a780-f324062f342a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3440fef6-b7ab-473a-a9cc-59bda5a7e862", "tag": "390e62c6-ae36-4c70-b2b1-25b19e6cfc84"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:52.648666 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-e29923de-779b-4eee-a434-04289eafa9bc req-44b20073-ff8a-42f0-a780-f324062f342a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:52.649328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-e29923de-779b-4eee-a434-04289eafa9bc req-44b20073-ff8a-42f0-a780-f324062f342a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:52.672014 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-e29923de-779b-4eee-a434-04289eafa9bc req-44b20073-ff8a-42f0-a780-f324062f342a service nova] Creating event network-changed:390e62c6-ae36-4c70-b2b1-25b19e6cfc84 for instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 on hv-cinder-84684 Jun 21 03:10:52.680355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-e29923de-779b-4eee-a434-04289eafa9bc req-44b20073-ff8a-42f0-a780-f324062f342a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044029 Jun 21 03:10:52.681445 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 168/338] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:10:52.934308 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:52.935158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:52.941805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:52.942481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:52.943416 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:52.943843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:53.210667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:53.218557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0348f872-de06-427e-b113-875b57433be9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.288085 Jun 21 03:10:53.219210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 171/339] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:52 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:53.560725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:53.561675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:53.569162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:53.569603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:53.570380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:53.570805 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:53.705270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:53.713073 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b5404f5e-a371-4665-9513-4e1fbf7d1b8e tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.158142 Jun 21 03:10:53.713625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 169/340] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:53 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:54.237136 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:54.237712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:54.247582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:54.248184 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:54.248992 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:54.249503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:54.268181 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:54.383219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:54.393912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-def68547-2664-4747-8b98-cf8e19f0eeff tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.162575 Jun 21 03:10:54.394494 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 172/341] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:54 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:54.733548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:54.734600 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:54.744995 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:54.745704 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:54.746923 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:54.747955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:54.886994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:54.895444 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e185c9db-57cd-483d-a4c9-b896a2d8012f tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.168165 Jun 21 03:10:54.895937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 170/342] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:54 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:55.415713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:55.416243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:55.423978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:55.424554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:55.425597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:55.426037 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:55.562795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:55.570940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-435b6b80-5537-4940-aee3-261ea57be031 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.159039 Jun 21 03:10:55.571500 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 173/343] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:55 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:55.921118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:55.922089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:55.929818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:55.930269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:55.930996 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:55.931418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:56.072816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:56.080298 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-915dfbf3-2c3d-488a-a1c9-53dc8d999d6a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.165661 Jun 21 03:10:56.080984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 171/344] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:55 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:56.587347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:56.587941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:56.594707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:56.595216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:56.596054 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:56.596535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:56.733289 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:56.741781 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d2f49751-01ac-4258-b49d-a7e7481553e4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.158120 Jun 21 03:10:56.742729 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 174/345] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:56 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:57.098048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:57.098773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:57.105224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:57.105780 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:57.106476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:57.106940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:57.109648 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=99 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:10:57.292374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:57.300810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-553c905c-c62d-4b2d-8121-7aced0052526 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.206363 Jun 21 03:10:57.304457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 172/346] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:57 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:57.759640 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:57.761140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:57.770346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:57.770878 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:57.772697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:57.774147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:58.048621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1835592938", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782746954", "security_groups": [{"name": "tempest-secgroup-smoke-1515630251"}], "block_device_mapping_v2": [{"uuid": "2a5f6f6d-c074-43cf-9bab-aff6790f8e0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65ee22e2-1b27-4fab-b33d-329c4e3c290a"}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:10:58.100192 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:58.108207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-901234df-f6b5-4256-bc00-91af5162866d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.352537 Jun 21 03:10:58.108810 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 175/347] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:57 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:58.170008 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] validate_networks() for [('65ee22e2-1b27-4fab-b33d-329c4e3c290a', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:10:58.316433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:58.317313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:58.323406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:58.323916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:58.324757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:58.325245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:58.462306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:58.471385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eba42542-6194-4b40-8b16-086317b6a17c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.158765 Jun 21 03:10:58.472071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 176/348] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:58 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:58.654046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:10:58.654476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:10:58.654969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:10:58.655368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:10:58.655770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:10:58.664922 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:58.665364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:58.666337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:58.666769 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:58.685651 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for project 1a43462c60384cecb441ccf14de5672e. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:10:58.689653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for user 41c4d3bab2164767b8eefcb4427b65b7 and project 1a43462c60384cecb441ccf14de5672e. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:10:58.756601 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:10:58.759583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a5f6f6d-c074-43cf-9bab-aff6790f8e0f',volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:10:58.913538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1915b559-44ff-4072-bcfc-7705acb07ebb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.871234 Jun 21 03:10:58.914718 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 173/349] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:10:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 03:10:58.925704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dfcc1ca4-2ab7-439a-971e-04d2b97bf42b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:58.927298 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dfcc1ca4-2ab7-439a-971e-04d2b97bf42b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:59.007306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dfcc1ca4-2ab7-439a-971e-04d2b97bf42b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:59.027384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dfcc1ca4-2ab7-439a-971e-04d2b97bf42b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1095 microversion: 2.1 time: 0.106687 Jun 21 03:10:59.037668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 177/350] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:58 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1095 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:10:59.125916 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:59.127360 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:59.135033 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:59.135507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:59.136477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:59.136897 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:59.297688 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:59.305991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4a719acf-2aaf-41b8-941d-961d544cb9c9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.185110 Jun 21 03:10:59.306594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 174/351] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:59 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:10:59.488358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:10:59.489121 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:10:59.496835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:59.497666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:59.498522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:10:59.499318 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:10:59.638179 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:10:59.650552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-15b9e91a-f9ec-4e48-a641-e74405b49280 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.165931 Jun 21 03:10:59.651046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 178/352] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:10:59 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:00.044886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:00.045697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:00.056544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:00.057376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:00.058313 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:00.058892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:00.133877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:00.142001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-03bad54f-da7e-4653-9048-f3a6b6d091fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1193 microversion: 2.1 time: 0.101031 Jun 21 03:11:00.142552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 175/353] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:00 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:00.323023 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:00.323709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:00.330624 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:00.331087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:00.331823 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:00.332237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:00.490545 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:00.498850 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-79de6c0f-1b8d-4840-a0db-51be75b7b4c7 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.179504 Jun 21 03:11:00.499578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 179/354] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:00 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:00.667438 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:00.668052 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:00.674220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:00.674754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:00.675653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:00.676220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:00.820469 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:00.830142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-12d851b2-65d6-4a21-9d07-1b1901178486 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.166445 Jun 21 03:11:00.831242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 176/355] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:00 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:01.047233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-08a3e4c0-38fe-47ef-a0bb-aecdfa0939ca req-e8cf24b6-545f-42a3-9d60-00159874d554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3440fef6-b7ab-473a-a9cc-59bda5a7e862", "name": "network-vif-plugged", "status": "completed", "tag": "390e62c6-ae36-4c70-b2b1-25b19e6cfc84"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:01.056059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-08a3e4c0-38fe-47ef-a0bb-aecdfa0939ca req-e8cf24b6-545f-42a3-9d60-00159874d554 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.056592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-08a3e4c0-38fe-47ef-a0bb-aecdfa0939ca req-e8cf24b6-545f-42a3-9d60-00159874d554 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:01.068229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-08a3e4c0-38fe-47ef-a0bb-aecdfa0939ca req-e8cf24b6-545f-42a3-9d60-00159874d554 service nova] Creating event network-vif-plugged:390e62c6-ae36-4c70-b2b1-25b19e6cfc84 for instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 on hv-cinder-84684 Jun 21 03:11:01.073943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-08a3e4c0-38fe-47ef-a0bb-aecdfa0939ca req-e8cf24b6-545f-42a3-9d60-00159874d554 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030702 Jun 21 03:11:01.074925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 180/356] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:01.159634 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:01.160772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:01.170259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.170658 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:01.171479 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.171908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:01.247843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:01.256005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2cd48288-aaa1-49e4-a10f-264b542f2dfe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1201 microversion: 2.1 time: 0.100683 Jun 21 03:11:01.256716 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 177/357] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:01 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:01.517784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:01.519510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:01.526539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.527070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:01.527860 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.528395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:01.680707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:01.689593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f2bd77cf-e446-4c92-9db8-61f2de58c951 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.176075 Jun 21 03:11:01.691543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 181/358] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:01 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:01.848154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:01.849049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:01.862309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.863618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:01.865632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:01.866783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.037877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:02.045548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7abeee1c-dfa5-4e89-9bd5-9bf78d5586fb tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.202290 Jun 21 03:11:02.046102 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 178/359] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:01 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:02.274248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:02.274904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:02.281985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.282524 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.283218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.283648 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.350696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:02.358386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-13351963-07b0-4208-a401-4393cc04c862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1211 microversion: 2.1 time: 0.089185 Jun 21 03:11:02.358947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 182/360] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:02 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:02.707997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:02.708609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:02.714992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.715426 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.716178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.716661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.849181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:02.857261 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-033179cb-a163-41d2-a424-8620a9d8acfb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1502 microversion: 2.1 time: 0.153559 Jun 21 03:11:02.857940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 179/361] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:02 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:02.874480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "530200dd-e47c-455f-9b36-b71a68d11591"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:02.875681 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:02.882534 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.883052 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.883855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.884341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.907550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] HTTP exception thrown: Cannot 'attach_volume' instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 while it is in vm_state rescued Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Request method failure captured: Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/os-volume_attachments HTTP/1.1 Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 74 Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZFsE57y111iJ6jScviONiJarz-kohNHNtmD6ZXTo-M9n7SkKUTRGok56P_1k6ps01sUdEqJbv1q355v3rAkFUJhCjf3wx3dONdKixDnhRQ-WupcbXee0O9GhSs-vulJ5vSQERSuGotTDKLgjXri_qgHMkrPo2uz1gwUN5foj0u5pQ Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:11:02.909717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262f17284a44afaa2b5d2d2db0a3ef6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 8bd2fc9f3216425cbcbbed84b7815529 Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {"volumeAttachment": {"volumeId": "530200dd-e47c-455f-9b36-b71a68d11591"}} Jun 21 03:11:02.911207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Cannot 'attach_volume' instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 while it is in vm_state rescued Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'server_id': 'aaa1873d-908f-4d20-b5f3-5c6c74ea0294', 'body': {'volumeAttachment': {'volumeId': '530200dd-e47c-455f-9b36-b71a68d11591'}}} Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:11:02.912078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 while it is in vm_state rescued Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:11:02.913348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 while it is in vm_state rescued Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Returning 409 to user: Cannot 'attach_volume' instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 while it is in vm_state rescued {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e887009c-c7ad-4e37-b994-416858b230cf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041316 Jun 21 03:11:02.914389 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 183/362] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:11:02 2022] POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 21 03:11:02.920924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:02.921454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:02.927825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.928343 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:02.929141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:02.929591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.006117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6db1d3cb-f267-4c0e-bf76-2cbe8aba8c8b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/action" status: 202 len: 0 microversion: 2.1 time: 0.088867 Jun 21 03:11:03.007051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 180/363] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:11:02 2022] POST /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:11:03.015643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:03.016336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:03.023059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:03.023592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.024464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:03.024956 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.063157 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:03.063759 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:03.070567 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:03.070999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.071772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:03.072227 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.282990 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:03.293621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e9fb1b85-b63e-458f-90d7-845a0bae5a20 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.234848 Jun 21 03:11:03.304439 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:03 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:03.351456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:03.359021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a83e89c8-dc75-40e1-8027-59d41bc01d9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1510 microversion: 2.1 time: 0.347439 Jun 21 03:11:03.359923 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:03 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:03.377179 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:03.378493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:03.385848 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:03.386499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.387256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:03.387681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:03.557766 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:03.567058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-09f42c83-f54d-4fac-bdbf-6d0e1969b647 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1279 microversion: 2.1 time: 0.193813 Jun 21 03:11:03.567631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 182/366] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:03 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:04.311914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:04.312557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:04.319695 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.320163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.320974 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.321497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.376872 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-9d0ce6d1-ddfd-4720-a55e-32e27c242b0a req-36d87ca9-baf8-456e-99ee-61850ebe333b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4150dd80-06fc-4868-a656-f2d72b1552a8", "tag": "4eb3a576-26df-497c-a783-cc6b344c468a"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:04.386083 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9d0ce6d1-ddfd-4720-a55e-32e27c242b0a req-36d87ca9-baf8-456e-99ee-61850ebe333b service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.387509 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9d0ce6d1-ddfd-4720-a55e-32e27c242b0a req-36d87ca9-baf8-456e-99ee-61850ebe333b service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.447086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-9d0ce6d1-ddfd-4720-a55e-32e27c242b0a req-36d87ca9-baf8-456e-99ee-61850ebe333b service nova] Creating event network-changed:4eb3a576-26df-497c-a783-cc6b344c468a for instance 4150dd80-06fc-4868-a656-f2d72b1552a8 on hv-cinder-84684 Jun 21 03:11:04.466131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-9d0ce6d1-ddfd-4720-a55e-32e27c242b0a req-36d87ca9-baf8-456e-99ee-61850ebe333b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086634 Jun 21 03:11:04.467372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 183/367] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:11:04.474646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:04.476388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:04.486130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.486955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.488387 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.488978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.510996 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:04.524872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2b24af54-0bbe-4260-93cb-760ac328ca22 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1319 microversion: 2.1 time: 0.216919 Jun 21 03:11:04.535065 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 185/368] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:04 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:04.583532 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:04.584122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:04.590348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.590791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.591540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:04.591966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:04.810888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:04.821936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-86b8b099-0862-4835-8a3a-b25732413b91 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1279 microversion: 2.1 time: 0.242270 Jun 21 03:11:04.822738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 186/369] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:04 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:11:04.933955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:04.952486 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-26d41272-cb64-4ac4-9ece-ccc12607bcb1 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1510 microversion: 2.1 time: 0.483232 Jun 21 03:11:04.953321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 184/370] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:04 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:05.542107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:05.543049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:05.551153 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:05.551598 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:05.552352 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:05.552805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:05.749356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:05.758351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4a439462-0d2e-4c15-9223-7f52a3bb823d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1508 microversion: 2.1 time: 0.220023 Jun 21 03:11:05.758918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 187/371] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:05 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:05.838572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:05.839177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:05.845214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:05.845656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:05.846404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:05.846913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:05.970925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:05.972178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:05.978698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:05.979198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:05.980027 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:05.980557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:05.983984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:05.991924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-101bbf9c-5854-4775-91b9-330d79702f17 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.157157 Jun 21 03:11:05.992511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 185/372] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:05 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:06.134246 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:06.144654 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-de6a87f8-f416-4394-98e8-de2282f5fb99 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1510 microversion: 2.1 time: 0.177360 Jun 21 03:11:06.154370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:05 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:07.012885 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:07.013864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:07.024542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:07.025278 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:07.026524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:07.027392 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:07.162010 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:07.162559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:07.169458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:07.169983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:07.170828 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:07.171329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:07.180613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:07.188472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c0a3fc0e-536b-4c5e-aaaf-8905974614d6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.182180 Jun 21 03:11:07.189058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 186/374] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:07 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:07.310973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:07.319574 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-47ac983b-92fd-4de8-b2f8-ed479bef0a9e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1510 microversion: 2.1 time: 0.161467 Jun 21 03:11:07.320141 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 189/375] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:07 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:11:08.211844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:08.212913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:08.223383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:08.224094 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:08.225017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:08.225446 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:08.335818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:08.336511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:08.345288 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:08.346024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:08.346666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:08.347262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:08.370429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:08.378587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ae51f2f3-99d8-4584-964e-4ce1f5661a67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.174922 Jun 21 03:11:08.379215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 187/376] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:08 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:08.481633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:08.489849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-421cf9b8-6cce-41fc-9a18-439acc76a18a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1510 microversion: 2.1 time: 0.157840 Jun 21 03:11:08.490489 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 190/377] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:08 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:09.401364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:09.401364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:09.401364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=4 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:09.401364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=12 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:09.405126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:09.405585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:09.406379 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:09.406810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:09.507066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:09.507668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:09.509707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:09.515861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:09.516320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:09.517099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:09.517522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:09.521717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:09.560033 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:09.567594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ad2ebd79-3b22-4310-a0c9-4b8bc9c9c13b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.176118 Jun 21 03:11:09.568229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 188/378] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:09 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:09.684875 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:09.692769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4f4bc21d-a768-41cf-8342-5ea39120aaf2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1510 microversion: 2.1 time: 0.189484 Jun 21 03:11:09.693816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 191/379] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:09 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:11:10.585490 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:10.586064 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:10.592692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:10.593137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:10.593869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:10.594298 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:10.596850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:10.710613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:10.711308 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:10.718164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:10.718654 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:10.719642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:10.720135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:10.736248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:10.743928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0de3190c-c2de-40a3-9704-19c83ccc4bde tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.162354 Jun 21 03:11:10.744693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 189/380] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:10 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:10.866384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:10.875031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ffc3c96e-a7ff-47a5-87a1-00a947c7cf6a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1516 microversion: 2.1 time: 0.168153 Jun 21 03:11:10.879852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 192/381] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:10 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:11:11.763023 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:11.764081 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:11.766455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:11.773408 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:11.773944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:11.774740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:11.775162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:11.912596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:11.920653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-191c224b-59dd-4a4a-986d-997d11a6944b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.162982 Jun 21 03:11:11.921520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 190/382] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:11 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:12.937983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:12.938568 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:12.945762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:12.946201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:12.946942 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:12.947367 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:13.094190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:13.105880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2db659a0-e4f1-4334-816e-47c31a97f838 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.171476 Jun 21 03:11:13.106708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 193/383] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:12 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:13.276109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-603481d3-8f83-41f8-89eb-2a313a3acc60 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'create', calling method: .version_select at 0x7fe79a513ee0>, body: {"keypair": {"name": "tempest-keypair-1212661621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpmOuH95hGaj3WpVig+TsQOirOGoJZwp4Ws+as/XxPnF6/m5c4zmzMpRA4EM1usl2IdWul5UVOtl7s06JitfeQ3K/TwkHmnZEHFDXYWx3iz8CWLIo19dQR10xlDIfaRWQ=="}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:13.291419 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-603481d3-8f83-41f8-89eb-2a313a3acc60 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:11:13.295670 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-603481d3-8f83-41f8-89eb-2a313a3acc60 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for user 8bd2fc9f3216425cbcbbed84b7815529 and project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:11:13.321945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-603481d3-8f83-41f8-89eb-2a313a3acc60 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049719 Jun 21 03:11:13.322858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 191/384] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:11:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:11:14.125347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:14.125937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:14.133633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:14.134347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:14.135291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:14.135876 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:14.301736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:14.312912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-916fe0f2-128a-48a6-966c-089446011217 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.192769 Jun 21 03:11:14.313499 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 194/385] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:14 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:14.739739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1942062853", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09798fdc-1a5e-44af-acf8-2181549f3c85"}], "security_groups": [{"name": "tempest-securitygroup--1774162849"}], "key_name": "tempest-keypair-1212661621", "user_data": "}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:14.853935 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] validate_networks() for [('09798fdc-1a5e-44af-acf8-2181549f3c85', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:11:15.263337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:11:15.263898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:11:15.264541 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:11:15.265060 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:11:15.265601 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:11:15.279210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:15.279856 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:15.280870 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:15.281348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:15.300148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:11:15.305412 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Getting quotas for user 8bd2fc9f3216425cbcbbed84b7815529 and project 7262f17284a44afaa2b5d2d2db0a3ef6. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:11:15.318138 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:11:15.320513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:11:15.329723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:15.330332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:15.337395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:15.337838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:15.338587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:15.339014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:15.371070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-837d6de1-93d7-46df-8f79-8e25301da146 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.635999 Jun 21 03:11:15.372020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 192/386] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:11:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:11:15.382983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-12aea485-fd22-4f1f-8adc-56d9d1e7746d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:15.383558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-12aea485-fd22-4f1f-8adc-56d9d1e7746d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:15.439499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-12aea485-fd22-4f1f-8adc-56d9d1e7746d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:15.447567 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-12aea485-fd22-4f1f-8adc-56d9d1e7746d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1246 microversion: 2.1 time: 0.068517 Jun 21 03:11:15.448371 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 193/387] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:15 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:11:15.485902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:15.493522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c03b2a72-41ba-4236-b42b-dde7afbd0b46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.167663 Jun 21 03:11:15.494103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 195/388] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:15 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:16.464351 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:16.465169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:16.471515 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:16.471978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:16.472902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:16.473336 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:16.519148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:16.519725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:16.529204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:16.529738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:16.531003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:16.531740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:16.542815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:16.551061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-36551e03-d0db-4a69-b28c-bdc5ff63f4cc tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1298 microversion: 2.1 time: 0.090703 Jun 21 03:11:16.551871 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 194/389] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:16 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:16.900638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:16.909231 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-04bcc1ab-2408-41e1-b4a4-30d3514a4b52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.401820 Jun 21 03:11:16.910042 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 196/390] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:16 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:17.569335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:17.569955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:17.576991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:17.577852 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:17.578794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:17.579374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:17.743136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:17.752430 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9a27c134-c357-41ca-ac5e-11f9ddcc473a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.187483 Jun 21 03:11:17.753673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 195/391] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:17 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:11:17.926850 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:17.928361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:17.936405 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:17.937087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:17.938231 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:17.938758 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:18.218042 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:18.227265 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b235f1f0-f7e3-4986-ba1d-1b405b36e253 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.304519 Jun 21 03:11:18.233310 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 197/392] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:17 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:18.725277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-3a70a6ff-0ecb-4c2c-be65-ffa436251994 req-6b4d28ce-da55-46c8-ac53-15abdfa7b36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe59a7e-b84b-40b7-a271-0e7c697dfc5a", "tag": "56ab7ae3-05d0-4a62-8d32-6e2232855f49"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:18.738534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-3a70a6ff-0ecb-4c2c-be65-ffa436251994 req-6b4d28ce-da55-46c8-ac53-15abdfa7b36c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:18.739172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-3a70a6ff-0ecb-4c2c-be65-ffa436251994 req-6b4d28ce-da55-46c8-ac53-15abdfa7b36c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:18.764924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-3a70a6ff-0ecb-4c2c-be65-ffa436251994 req-6b4d28ce-da55-46c8-ac53-15abdfa7b36c service nova] Creating event network-changed:56ab7ae3-05d0-4a62-8d32-6e2232855f49 for instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a on hv-cinder-84684 Jun 21 03:11:18.771420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:18.774258 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:18.786699 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-3a70a6ff-0ecb-4c2c-be65-ffa436251994 req-6b4d28ce-da55-46c8-ac53-15abdfa7b36c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066126 Jun 21 03:11:18.787675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:18.791684 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 196/393] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:18.792304 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:18.793154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:18.796014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:19.037260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:19.048493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bcea9772-1b38-405b-90d7-a10747f7a09e tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.278180 Jun 21 03:11:19.049435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 198/394] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:18 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:19.249333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:19.251766 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:19.260255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:19.260831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:19.261682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:19.262166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:19.405858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:19.415245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c6151893-f25a-4466-af96-bd956f02e8f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.172843 Jun 21 03:11:19.415920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 197/395] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:19 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:19.608701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-086badf2-be80-4146-8120-15e946bbfbdc req-2d9f8bef-6ae5-493c-8b0f-ed02ef411bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4150dd80-06fc-4868-a656-f2d72b1552a8", "name": "network-vif-plugged", "status": "completed", "tag": "4eb3a576-26df-497c-a783-cc6b344c468a"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:19.619195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-086badf2-be80-4146-8120-15e946bbfbdc req-2d9f8bef-6ae5-493c-8b0f-ed02ef411bfe service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:19.619641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-086badf2-be80-4146-8120-15e946bbfbdc req-2d9f8bef-6ae5-493c-8b0f-ed02ef411bfe service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:19.633314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-086badf2-be80-4146-8120-15e946bbfbdc req-2d9f8bef-6ae5-493c-8b0f-ed02ef411bfe service nova] Creating event network-vif-plugged:4eb3a576-26df-497c-a783-cc6b344c468a for instance 4150dd80-06fc-4868-a656-f2d72b1552a8 on hv-cinder-84684 Jun 21 03:11:19.639265 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-086badf2-be80-4146-8120-15e946bbfbdc req-2d9f8bef-6ae5-493c-8b0f-ed02ef411bfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Jun 21 03:11:19.639863 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 199/396] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:20.068233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:20.068233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:20.075749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:20.076193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:20.077160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:20.077594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:20.225105 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:20.233214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0f694262-2c60-4454-9308-4d8ab2109fb6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.171297 Jun 21 03:11:20.233865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 198/397] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:20 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:20.432371 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:20.433189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:20.435058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=68 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:20.440167 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:20.440680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:20.441413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:20.441838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:20.583020 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:20.591979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-53c8d75c-6475-4fca-b3c9-614054348122 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.164238 Jun 21 03:11:20.592575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 200/398] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:20 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:21.250727 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:21.251353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:21.257756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:21.258193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:21.258964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:21.259392 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:21.414992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:21.427134 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-386cfb97-14b8-42da-b28b-a858fc287369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.180192 Jun 21 03:11:21.427691 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 199/399] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:21 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:21.611867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:21.612558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:21.619834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:21.620282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:21.621218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:21.621655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:21.756141 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:21.764443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-35dabb7f-fae3-490b-a980-a56e954ed601 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.158798 Jun 21 03:11:21.765035 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 201/400] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:21 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:22.448725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:22.449553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:22.460574 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:22.461324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:22.462587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:22.463320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:22.616795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:22.629820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c81109f3-a82c-4feb-85d9-2c7e825d09e6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.187943 Jun 21 03:11:22.631137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 200/401] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:22 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:22.785010 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:22.785930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:22.793235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:22.793679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:22.794426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:22.794854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:22.940143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:22.948014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e999957-8fd5-4028-a308-468c7e622d3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.169515 Jun 21 03:11:22.948601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 202/402] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:22 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:23.647659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:23.648260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:23.654831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:23.655297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:23.656053 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:23.656472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:23.826634 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:23.838078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2d0f4614-8a94-4771-8120-ab594dec3b54 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.194159 Jun 21 03:11:23.838928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 201/403] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:23 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:23.968107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:23.969063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:23.979311 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:23.980016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:23.981170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:23.981849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:24.127020 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:24.134751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9d422880-1dc7-4f85-a63a-b69759888b3f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.172611 Jun 21 03:11:24.135251 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 203/404] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:23 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:24.858645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:24.859243 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:24.865448 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:24.865884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:24.866613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:24.867035 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:24.998151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:25.009041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a15d8e23-098c-446d-b374-ddea9b63c16c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.153935 Jun 21 03:11:25.009598 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 202/405] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:24 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:25.156622 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:25.157489 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:25.165971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:25.166414 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:25.167171 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:25.167849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:25.382147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:25.390050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-731efb07-04bc-4655-a125-e92626b6ac10 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1267 microversion: 2.1 time: 0.240010 Jun 21 03:11:25.390615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 204/406] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:25 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:26.026733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:26.027325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:26.029356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:26.030047 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=12 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:26.035572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.036021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.036949 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.037390 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.179953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:26.187530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-03f01815-e26c-41f5-9b6c-73b8895dde4b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.164737 Jun 21 03:11:26.188082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 203/407] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:26 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:26.407699 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:26.408953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:26.417195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.417696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.418629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.419098 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.437252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-6976eaf8-3f64-4918-b4c6-2712f4a37452 req-983f390b-8ddb-4f28-a617-39b6a2a34010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe59a7e-b84b-40b7-a271-0e7c697dfc5a", "name": "network-vif-plugged", "status": "completed", "tag": "56ab7ae3-05d0-4a62-8d32-6e2232855f49"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:26.445896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-6976eaf8-3f64-4918-b4c6-2712f4a37452 req-983f390b-8ddb-4f28-a617-39b6a2a34010 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.446409 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-6976eaf8-3f64-4918-b4c6-2712f4a37452 req-983f390b-8ddb-4f28-a617-39b6a2a34010 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.459579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-6976eaf8-3f64-4918-b4c6-2712f4a37452 req-983f390b-8ddb-4f28-a617-39b6a2a34010 service nova] Creating event network-vif-plugged:56ab7ae3-05d0-4a62-8d32-6e2232855f49 for instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a on hv-cinder-84684 Jun 21 03:11:26.465422 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-6976eaf8-3f64-4918-b4c6-2712f4a37452 req-983f390b-8ddb-4f28-a617-39b6a2a34010 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 Jun 21 03:11:26.466030 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 204/408] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:26.559493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:26.569667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2f0888e5-6ef1-4966-b015-cc516b0b4a52 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1454 microversion: 2.1 time: 0.166220 Jun 21 03:11:26.570222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 205/409] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:26 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:26.596832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:26.597960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:26.604858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.605300 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.606044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:26.606471 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:26.752227 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:26.761202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c57ba4a8-1650-4f77-997e-208e5273194c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1454 microversion: 2.1 time: 0.171564 Jun 21 03:11:26.761722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 205/410] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:26 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:27.204871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:27.205636 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:27.213394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:27.214055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:27.214842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:27.215437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:27.431079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:27.439150 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f2d155db-0696-4243-aaaf-d07a40751c46 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.238314 Jun 21 03:11:27.439689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 206/411] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:27 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:28.456557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:28.457144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:28.463473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:28.463916 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:28.464705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:28.465132 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:28.603784 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:28.611210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1c80418e-3072-472e-bb4b-9c263dba78f8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.158582 Jun 21 03:11:28.613837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 206/412] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:28 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:28.742345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-79d1adf3-8019-4c27-ac02-32ee1cba07fb req-04a17ecc-1854-40f2-aa44-141748da32ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4150dd80-06fc-4868-a656-f2d72b1552a8", "tag": "4eb3a576-26df-497c-a783-cc6b344c468a"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:28.751146 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-79d1adf3-8019-4c27-ac02-32ee1cba07fb req-04a17ecc-1854-40f2-aa44-141748da32ad service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:28.751577 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-79d1adf3-8019-4c27-ac02-32ee1cba07fb req-04a17ecc-1854-40f2-aa44-141748da32ad service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:28.762815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-79d1adf3-8019-4c27-ac02-32ee1cba07fb req-04a17ecc-1854-40f2-aa44-141748da32ad service nova] Creating event network-changed:4eb3a576-26df-497c-a783-cc6b344c468a for instance 4150dd80-06fc-4868-a656-f2d72b1552a8 on hv-cinder-84684 Jun 21 03:11:28.767834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-79d1adf3-8019-4c27-ac02-32ee1cba07fb req-04a17ecc-1854-40f2-aa44-141748da32ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030045 Jun 21 03:11:28.768715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 207/413] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:29.629235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:29.629924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:29.637216 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:29.637735 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:29.638500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:29.638927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:29.786982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:29.794915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ebb1a3b5-3e4a-44a8-af96-5a787e0813ab tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1372 microversion: 2.1 time: 0.169468 Jun 21 03:11:29.795413 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 207/414] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:29 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:30.814313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:30.815001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:30.823722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:30.824467 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:30.825395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:30.826051 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:30.972927 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:11:30.981052 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e1b1ee3a-21aa-4423-810b-07f791513250 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1567 microversion: 2.1 time: 0.172033 Jun 21 03:11:30.981709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 208/415] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:11:30 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:11:30.997852 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:11:30.998366 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:31.004351 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:31.004825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:31.005642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:31.006200 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:31.103464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-32ba3893-8666-40e2-9b48-f24380c00834 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109512 Jun 21 03:11:31.104342 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 208/416] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:11:30 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:31.577344 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a5183d9-897b-456e-b7e9-4403d10fcfe1", "device": "/dev/sdb"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:31.578852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:11:31.586556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:31.587111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:31.587945 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:31.588442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:31.592980 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:11:31.889715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0b95ef3a-cd5a-48ef-8758-f83e2e5eaedd tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "POST /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316457 Jun 21 03:11:31.890439 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 209/417] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:11:31 2022] POST /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:11:32.352094 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-0c713f20-abe2-44a4-beaf-d9b5863f81e2 req-91222011-9395-4912-88b0-2ccd4e982ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe59a7e-b84b-40b7-a271-0e7c697dfc5a", "tag": "56ab7ae3-05d0-4a62-8d32-6e2232855f49"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:11:32.360740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-0c713f20-abe2-44a4-beaf-d9b5863f81e2 req-91222011-9395-4912-88b0-2ccd4e982ff3 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:11:32.361171 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-0c713f20-abe2-44a4-beaf-d9b5863f81e2 req-91222011-9395-4912-88b0-2ccd4e982ff3 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:11:32.372936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-0c713f20-abe2-44a4-beaf-d9b5863f81e2 req-91222011-9395-4912-88b0-2ccd4e982ff3 service nova] Creating event network-changed:56ab7ae3-05d0-4a62-8d32-6e2232855f49 for instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a on hv-cinder-84684 Jun 21 03:11:32.378365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-0c713f20-abe2-44a4-beaf-d9b5863f81e2 req-91222011-9395-4912-88b0-2ccd4e982ff3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030675 Jun 21 03:11:32.378951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 209/418] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:10.247876 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:10.248461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:10.251235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=19 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:10.252154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:10.260134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:10.260794 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:10.261550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:10.261979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:10.389846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lazy-loading 'services' on Instance uuid 3440fef6-b7ab-473a-a9cc-59bda5a7e862 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:12:10.508959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1f1a58c8-7bad-4270-8b47-b97013b5c042 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862/os-volume_attachments/6a5183d9-897b-456e-b7e9-4403d10fcfe1" status: 202 len: 0 microversion: 2.1 time: 0.265620 Jun 21 03:12:10.509402 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 210/419] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:12:10 2022] DELETE /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862/os-volume_attachments/6a5183d9-897b-456e-b7e9-4403d10fcfe1 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:12:12.702683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:12.703430 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=95 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:12.708595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:12.709177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:12.716450 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:12.716910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:12.717660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:12.718092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:12.743380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:12:12.835770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c2a99af4-94c1-4858-9488-9b8cedd5edf1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 204 len: 0 microversion: 2.1 time: 0.134862 Jun 21 03:12:12.836342 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 210/420] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:12:12 2022] DELETE /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:12:12.846135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:12.846861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:12.853610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:12.854063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:12.854797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:12.855221 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:12.995112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:13.003179 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-741dad6d-b5ff-4374-aec9-15ddb46ef25a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1514 microversion: 2.1 time: 0.162180 Jun 21 03:12:13.003742 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 211/421] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:12 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:14.030942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:14.031992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:14.039895 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:14.040344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:14.041126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:14.041558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:14.181091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:14.188596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7da095fa-c633-435b-b477-6fcc4d301e83 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1514 microversion: 2.1 time: 0.164873 Jun 21 03:12:14.189116 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 211/422] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:14 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:15.205989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:15.206595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:15.213676 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:15.214116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:15.214859 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:15.215291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:15.434736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:15.442781 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-10da5301-e38b-4ec3-96f5-9cf8dc3aed3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 200 len: 1514 microversion: 2.1 time: 0.240671 Jun 21 03:12:15.452242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 212/423] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:15 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:15.785626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-ea454e5a-15a4-4df4-9892-de4184e7e892 req-13319aa3-08bf-41b7-b8a8-1820a74a1c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3440fef6-b7ab-473a-a9cc-59bda5a7e862", "name": "network-vif-deleted", "tag": "390e62c6-ae36-4c70-b2b1-25b19e6cfc84"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:15.794374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-ea454e5a-15a4-4df4-9892-de4184e7e892 req-13319aa3-08bf-41b7-b8a8-1820a74a1c49 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:15.794811 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-ea454e5a-15a4-4df4-9892-de4184e7e892 req-13319aa3-08bf-41b7-b8a8-1820a74a1c49 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:15.806346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-ea454e5a-15a4-4df4-9892-de4184e7e892 req-13319aa3-08bf-41b7-b8a8-1820a74a1c49 service nova] Creating event network-vif-deleted:390e62c6-ae36-4c70-b2b1-25b19e6cfc84 for instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 on hv-cinder-84684 Jun 21 03:12:15.811400 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-ea454e5a-15a4-4df4-9892-de4184e7e892 req-13319aa3-08bf-41b7-b8a8-1820a74a1c49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029461 Jun 21 03:12:15.812066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 212/424] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:15.849158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:12:15.849413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:12:16.459429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:16.460128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: 3440fef6-b7ab-473a-a9cc-59bda5a7e862] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:16.467602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:16.468122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:16.469060 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:16.469558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:16.483119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] HTTP exception thrown: Instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 could not be found. Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Request method failure captured: Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 HTTP/1.1 Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTa3rLv8Me3JDkVBHESCFN1xbMRvRaM61TMkJBGp4CJjdEEzj7WQFAqHVIsspyCVktLhzi2sTuh5DbBMWiL1dTi64a2UvCJ5bouJ1cICz4K0dqh3iUpywj5gQlTHw0r_MlJBIqnR-Ju4o6mJ_sgnYH1NRrizsa9mfSXUlX5rourthiw Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 0d8e2178a3c84520ac00fc1cf2da0329 Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1727898766 Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:12:16.484782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8e2178a3c84520ac00fc1cf2da0329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8e2178a3c84520ac00fc1cf2da0329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8e2178a3c84520ac00fc1cf2da0329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8e2178a3c84520ac00fc1cf2da0329", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotTestJSON-1727898766 Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 0d8e2178a3c84520ac00fc1cf2da0329 Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1727898766 Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotTestJSON-1727898766-project Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 4d0e5c4a49d84ab9ab4c2db7d09e6fac Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotTestJSON-1727898766-project Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 could not be found. Jun 21 03:12:16.486406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '3440fef6-b7ab-473a-a9cc-59bda5a7e862'} Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 could not be found. Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:12:16.487346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 could not be found. Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 could not be found. Jun 21 03:12:16.488820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:12:16.490151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Returning 404 to user: Instance 3440fef6-b7ab-473a-a9cc-59bda5a7e862 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:12:16.490151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1a99d2e0-b988-41d1-97d5-dbcb4bf0b16c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862" status: 404 len: 111 microversion: 2.1 time: 0.030668 Jun 21 03:12:16.490544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 213/425] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:16 2022] GET /compute/v2.1/servers/3440fef6-b7ab-473a-a9cc-59bda5a7e862 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:12:28.098058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:28.098802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:28.103132 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:28.103753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:28.111665 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:28.112134 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:28.112927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:28.113936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:28.138812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-17b78a5c-a2ce-4a2a-af30-564d82e92401 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/ips" status: 200 len: 149 microversion: 2.1 time: 0.042585 Jun 21 03:12:28.139367 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 213/426] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:12:28 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:28.487063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1331424339", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "networks": [{"uuid": "f2abf431-f273-437a-aebe-28a3974ec06c"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:28.494679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=8 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:28.495421 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:28.542080 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] validate_networks() for [('f2abf431-f273-437a-aebe-28a3974ec06c', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:12:28.932795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:12:28.933387 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:12:28.934087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:12:28.934597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:12:28.935101 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:12:28.946701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:28.947181 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:28.947938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:28.948359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:28.965670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Getting quotas for project 0d8e2178a3c84520ac00fc1cf2da0329. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:12:28.970005 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Getting quotas for user 4d0e5c4a49d84ab9ab4c2db7d09e6fac and project 0d8e2178a3c84520ac00fc1cf2da0329. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:12:28.982098 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:12:28.984323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:12:29.031666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c6663d39-7990-4e52-af5e-c58cfdc58f90 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548576 Jun 21 03:12:29.032589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 214/427] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:12:29.042424 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bea8fd90-5d48-4dbd-98ca-a095fabb7558 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:29.043042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-bea8fd90-5d48-4dbd-98ca-a095fabb7558 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:29.098906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-bea8fd90-5d48-4dbd-98ca-a095fabb7558 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:29.105962 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-bea8fd90-5d48-4dbd-98ca-a095fabb7558 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1219 microversion: 2.1 time: 0.067297 Jun 21 03:12:29.115731 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 214/428] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:29 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:29.512511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b313e19-ed14-44b0-bbf7-9668be9abfef"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:29.513796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:29.523030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:29.523648 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:29.524577 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:29.525012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:29.857626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6806260b-25d3-4761-9716-9683a0010307 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350095 Jun 21 03:12:29.862846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 215/429] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:12:29 2022] POST /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:30.123547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:30.124137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:30.130927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:30.131366 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:30.132111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:30.132592 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:30.224218 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:30.231892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-367e616b-7e06-4811-b730-b712f958acde tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1271 microversion: 2.1 time: 0.112556 Jun 21 03:12:30.235125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 215/430] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:30 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:30.710313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:30.710838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:30.720659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:30.721186 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:30.722035 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:30.722780 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:30.751811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cfa2b49c-a105-4537-a257-331a20d497e9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/ips" status: 200 len: 143 microversion: 2.1 time: 0.047594 Jun 21 03:12:30.752394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 216/431] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:12:30 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/ips => generated 143 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:31.249573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:31.250158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:31.256711 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:31.257181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:31.257935 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:31.258352 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:31.391994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:31.400045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e99d5995-4451-45b5-aae8-1676ef2168a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.154691 Jun 21 03:12:31.400864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 216/432] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:31 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:31.718649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:31.719612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:31.726871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:31.727572 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:31.728330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:31.728780 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:31.755206 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5aefbc51-9b35-4253-81e3-abda492a3d18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/ips" status: 200 len: 151 microversion: 2.20 time: 0.041107 Jun 21 03:12:31.761771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 217/433] 10.222.0.16 () {60 vars in 1288 bytes} [Tue Jun 21 03:12:31 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:12:32.143771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-b7b47ad8-3f0f-4717-9023-286cf7296315 req-991d394b-e7f1-4097-ba51-70950a5aea1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3aeadc-9008-4eed-ac47-2492213bf82f", "tag": "de74322d-b2b1-4e78-983e-9e4f65495959"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:32.158783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-b7b47ad8-3f0f-4717-9023-286cf7296315 req-991d394b-e7f1-4097-ba51-70950a5aea1c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:32.159215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-b7b47ad8-3f0f-4717-9023-286cf7296315 req-991d394b-e7f1-4097-ba51-70950a5aea1c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:32.178557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-b7b47ad8-3f0f-4717-9023-286cf7296315 req-991d394b-e7f1-4097-ba51-70950a5aea1c service nova] Creating event network-changed:de74322d-b2b1-4e78-983e-9e4f65495959 for instance ef3aeadc-9008-4eed-ac47-2492213bf82f on hv-cinder-84684 Jun 21 03:12:32.184954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-b7b47ad8-3f0f-4717-9023-286cf7296315 req-991d394b-e7f1-4097-ba51-70950a5aea1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045584 Jun 21 03:12:32.185630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 217/434] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:32.417433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:32.418240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:32.424869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:32.425313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:32.426424 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:32.426860 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:32.627881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:32.635982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f9efa8cc-9ca9-4f69-9b3e-4df42c2a05f6 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.222404 Jun 21 03:12:32.645504 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 218/435] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:32 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:33.658213 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:33.659368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:33.666736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:33.667173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:33.667917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:33.668338 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:33.808487 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:33.820088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d3723ef5-1a99-43b9-adac-e94ad69bb789 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.168538 Jun 21 03:12:33.820854 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 218/436] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:33 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:34.112468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a73d067e-431f-4fe8-b454-d8ed2d71d1ae"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:34.113596 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:34.120111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:34.120587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:34.121324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:34.121767 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:34.724488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:34.725401 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:34.736087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:34.736990 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:34.738331 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:34.739077 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:34.762448 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lazy-loading 'flavor' on Instance uuid bade48e3-65d3-406d-8d36-53e1f560e554 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:12:35.087660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2285f701-4fa4-4a3e-bfc5-0cecdd838fed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/action" status: 202 len: 0 microversion: 2.20 time: 0.369640 Jun 21 03:12:35.088297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 219/437] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jun 21 03:12:34 2022] POST /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:12:35.093762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:35.094440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:35.102044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:35.102478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:35.103220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:35.103644 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:35.239836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:35.247971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-092b4de2-57dd-438a-ac57-23ac2a196296 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.158563 Jun 21 03:12:35.252465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 220/438] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:35 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:35.254594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:35.255183 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:35.262170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:35.262610 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:35.263352 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:35.263773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:35.409958 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:35.422841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:35.425222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:35.426576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d3a3e325-054b-4444-b4f7-b44cc2e5e54d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.177089 Jun 21 03:12:35.427131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 221/439] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:35 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:36.268481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:36.269737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:36.276340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:36.276815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:36.277559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:36.277979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:36.416741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:36.424700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-869d5ceb-873f-4208-8687-536710c452d4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.162503 Jun 21 03:12:36.425225 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 222/440] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:36 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:36.445889 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:36.446481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:36.452965 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:36.453390 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:36.454131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:36.454557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:36.590602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:36.599100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:36.600603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:36.601749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cc000644-32c3-4fbe-8a9b-16bfef458c17 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.159523 Jun 21 03:12:36.602299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 223/441] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:36 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:12:37.331305 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ae868ea-ccef-42f5-a1dd-4ade15d69e22 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.222556 Jun 21 03:12:37.332379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 219/442] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:12:34 2022] POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-volume_attachments => generated 194 bytes in 3224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:37.445736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:37.447365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:37.457154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:37.457606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:37.458385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:37.458814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:37.598422 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:37.605937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7f2105c5-b2e4-43a7-852e-b9ec6dc2655d tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.165667 Jun 21 03:12:37.606494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 224/443] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:37 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:37.620399 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:37.621119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:37.627700 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:37.628147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:37.628963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:37.629492 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:37.889933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:37.899323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:37.901604 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:37.903060 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-deec3095-0252-420e-988a-29acb14fcb15 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.287404 Jun 21 03:12:37.904429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 220/444] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:37 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:38.535570 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6225254c-7ba4-4d8d-a88d-f4faae1b4817 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: .version_select at 0x7fe79a610a60>, body: {"keypair": {"name": "tempest-keypair-845012247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk7oWynHWtd4SxaYyDAeSiU9ytOXgK/SIsqn8DYmJQh7nCLqnLXHTCsi2SB3FB9DbtUVHNG5e1oTM3q8bXOIa3k/hkM2KpR6K44IQt707T8pqCp+2vc1gM/a4/EDeqmaA=="}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:38.552797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-6225254c-7ba4-4d8d-a88d-f4faae1b4817 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:12:38.556724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-6225254c-7ba4-4d8d-a88d-f4faae1b4817 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:12:38.580917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6225254c-7ba4-4d8d-a88d-f4faae1b4817 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049407 Jun 21 03:12:38.581489 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 225/445] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:12:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:38.622999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:38.623603 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:38.630458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:38.630899 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:38.631661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:38.632086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:38.812456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:38.820004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a32117df-2761-4659-b5e1-76cea193a9e3 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.201103 Jun 21 03:12:38.820607 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 221/446] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:38 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:38.921303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:38.921974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:38.928015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:38.928576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:38.929396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:38.929904 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:39.063189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:39.072398 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:39.073911 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:39.075069 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c625c0a3-b575-4882-811e-4dce4d33f186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.157923 Jun 21 03:12:39.075925 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 226/447] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:38 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:39.453258 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-dc31c624-e480-402c-9151-2b4a3819840a req-4d27757b-017b-41d8-a3bb-a60b4038fc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3aeadc-9008-4eed-ac47-2492213bf82f", "name": "network-vif-plugged", "status": "completed", "tag": "de74322d-b2b1-4e78-983e-9e4f65495959"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:39.457925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:39.459780 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:39.469923 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-dc31c624-e480-402c-9151-2b4a3819840a req-4d27757b-017b-41d8-a3bb-a60b4038fc7e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:39.470610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-dc31c624-e480-402c-9151-2b4a3819840a req-4d27757b-017b-41d8-a3bb-a60b4038fc7e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:39.482899 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-dc31c624-e480-402c-9151-2b4a3819840a req-4d27757b-017b-41d8-a3bb-a60b4038fc7e service nova] Creating event network-vif-plugged:de74322d-b2b1-4e78-983e-9e4f65495959 for instance ef3aeadc-9008-4eed-ac47-2492213bf82f on hv-cinder-84684 Jun 21 03:12:39.488351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-dc31c624-e480-402c-9151-2b4a3819840a req-4d27757b-017b-41d8-a3bb-a60b4038fc7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040367 Jun 21 03:12:39.489601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 222/448] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:39.837742 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:39.838621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:39.845517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:39.846573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:39.847876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:39.848327 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:39.987703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:39.995274 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1b0d0cce-7dcb-435b-bff7-f9de29e65cb7 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.161980 Jun 21 03:12:39.995810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 227/449] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:39 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:40.008446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1788325790", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c23877e-0103-47a1-a2d4-5b0d47022cc2"}], "security_groups": [{"name": "tempest-securitygroup--1648408140"}], "key_name": "tempest-keypair-845012247", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:40.093214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:40.093815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:40.100041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:40.100524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:40.101282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:40.101688 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:40.126156 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] validate_networks() for [('4c23877e-0103-47a1-a2d4-5b0d47022cc2', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:12:40.231672 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:40.239995 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:40.241517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:40.242771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8b67fc2f-9808-4d00-beb3-24dd6789e1b7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.153390 Jun 21 03:12:40.243320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 228/450] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:40 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:40.516883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:12:40.517621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:12:40.518408 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:12:40.519072 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:12:40.520437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:12:40.530243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:40.530685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:40.531454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:40.531878 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:40.548860 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:12:40.553042 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:12:40.564688 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:12:40.567067 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:12:40.621725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cadce91f-6f64-4d85-b901-597ddd4a5639 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.618058 Jun 21 03:12:40.622684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 223/451] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:12:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:12:40.633011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a9099d0c-865d-43ff-863f-0f6f04e387f6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:40.633614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a9099d0c-865d-43ff-863f-0f6f04e387f6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:40.686103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a9099d0c-865d-43ff-863f-0f6f04e387f6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:40.692892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a9099d0c-865d-43ff-863f-0f6f04e387f6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1241 microversion: 2.1 time: 0.064094 Jun 21 03:12:40.693454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 229/452] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:40 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:12:41.013469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:41.014070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:41.021131 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:41.021571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:41.022313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:41.022743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:41.157448 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:41.165978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6f84b542-d807-45db-82b9-2707abeb0828 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.156442 Jun 21 03:12:41.166585 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 224/453] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:41 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:41.265046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:41.266048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:41.274070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:41.274514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:41.275267 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:41.275695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:41.412571 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:41.420756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:41.422232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:41.423383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9d005e91-b595-4015-9f79-669e0f91bb6d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.164819 Jun 21 03:12:41.423931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 230/454] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:41 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:41.709825 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:41.710423 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:41.717270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:41.717710 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:41.718495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:41.718911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:41.781126 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:41.788925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5ab50bde-2c40-4450-ac53-44c152656df9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1293 microversion: 2.1 time: 0.082848 Jun 21 03:12:41.789481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 225/455] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:41 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:42.182941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:42.183540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:42.190050 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:42.190508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:42.191468 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:42.191904 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:42.212253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:42.330011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:42.340361 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ecf81447-8c18-47c4-a897-f96bcf3d3238 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1319 microversion: 2.1 time: 0.161160 Jun 21 03:12:42.341121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 231/456] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:42 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:42.446638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:42.447468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:42.457796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:42.458527 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:42.459754 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:42.460484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:42.615105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:42.623920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:42.625487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:42.626659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-81a93b83-c1e9-4f28-a426-a8149460bfed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.186885 Jun 21 03:12:42.627189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 226/457] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:42 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:42.807568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:42.808260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:42.815658 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:42.816166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:42.817050 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:42.817475 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:42.879069 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:42.887285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-94080321-2215-4c20-abcc-08848b8c9002 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1301 microversion: 2.1 time: 0.084844 Jun 21 03:12:42.888072 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 232/458] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:42 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:43.359178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:43.359796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:43.366832 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.367287 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.368047 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.368495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.572625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:43.580326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8381e5f9-8155-4ccb-b20e-c224f302d102 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1507 microversion: 2.1 time: 0.224976 Jun 21 03:12:43.580883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:43 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:43.597015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "226c6e85-a427-4f2e-8462-0bc01ad6f080", "device": "/dev/sdb"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:43.598898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:43.605507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.605944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.606693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.607814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.646046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:43.646712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:43.653071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.653746 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.654711 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.655426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.849432 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:43.860132 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:43.861988 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:43.863284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ef1c418-998a-415b-a1ee-e97332e01313 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.221299 Jun 21 03:12:43.863840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 228/460] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:43 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:43.904445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:43.905069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:43.911320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.911918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:43.912724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:43.913147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:44.049144 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:44.056816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3ec71a95-9f56-4f13-82f3-7a5c53cf1f7d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.156267 Jun 21 03:12:44.057375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 229/461] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:43 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:12:44.882705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:44.883470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:44.891779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:44.892803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:44.893806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:44.894445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:44.915361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:45.123649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:45.134771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:45.136971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:45.138757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0db32737-7360-4314-87b0-1ab89f9d9b59 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.260547 Jun 21 03:12:45.151321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 230/462] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:44 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:12:45.159190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:45.160569 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:45.169456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:45.170122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:45.171030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:45.172196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:45.195755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-52cd4cd9-563f-4a86-9215-c2ed021f0ec1 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "POST /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.602549 Jun 21 03:12:45.201497 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 233/463] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:12:43 2022] POST /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f/os-volume_attachments => generated 194 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:45.228841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-f778385e-d1ba-40ed-9246-1e860c023469 req-ed4bc47a-d1b7-4af6-8dbd-6d575c6890f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ebc898-2fa4-4c13-b321-a788afa0bd84", "tag": "609de0d2-a25b-4db4-a7ec-dd2c6422bb8b"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:45.258998 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-f778385e-d1ba-40ed-9246-1e860c023469 req-ed4bc47a-d1b7-4af6-8dbd-6d575c6890f8 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:45.259506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-f778385e-d1ba-40ed-9246-1e860c023469 req-ed4bc47a-d1b7-4af6-8dbd-6d575c6890f8 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:45.287231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-f778385e-d1ba-40ed-9246-1e860c023469 req-ed4bc47a-d1b7-4af6-8dbd-6d575c6890f8 service nova] Creating event network-changed:609de0d2-a25b-4db4-a7ec-dd2c6422bb8b for instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 on hv-cinder-84684 Jun 21 03:12:45.292821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-f778385e-d1ba-40ed-9246-1e860c023469 req-ed4bc47a-d1b7-4af6-8dbd-6d575c6890f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067914 Jun 21 03:12:45.293726 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 234/464] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:12:45.370242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:45.380680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-09b7e24d-5aff-45b4-80f2-834b52a4c891 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.227113 Jun 21 03:12:45.381255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 231/465] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:45 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:45.943764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dc333c90-bd27-4210-8c03-bcb990c1b466 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:45.950611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dc333c90-bd27-4210-8c03-bcb990c1b466 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:45.951011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dc333c90-bd27-4210-8c03-bcb990c1b466 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.010626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dc333c90-bd27-4210-8c03-bcb990c1b466 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Going to try to stop instance {{(pid=117663) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 03:12:46.055893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dc333c90-bd27-4210-8c03-bcb990c1b466 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action" status: 202 len: 0 microversion: 2.1 time: 0.116651 Jun 21 03:12:46.056506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 235/466] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:12:45 2022] POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:12:46.064768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:46.065376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:46.072197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:46.072686 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.073438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:46.073869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.157867 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:46.159306 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:46.166831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:46.167462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.168901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:46.169498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.212446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:46.221470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fc8b5111-7498-4460-bed0-45751b1719c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.160434 Jun 21 03:12:46.222041 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 232/467] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:46 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:46.309883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:46.317878 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:46.319388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:46.320505 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c49e6c07-1646-4746-ae57-399c79da0631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.166926 Jun 21 03:12:46.321203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 236/468] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:46 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:46.398629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:46.399351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:46.406130 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:46.406571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.407311 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:46.407735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:46.540041 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:46.551093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e00699d-eaac-42e9-8385-9ef092557f57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.156272 Jun 21 03:12:46.551685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 233/469] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:46 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:47.241575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:47.242268 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:47.250290 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:47.250774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:47.251597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:47.252067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:47.338800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:47.339413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:47.346336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:47.346785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:47.347934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:47.348397 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:47.491216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:47.500019 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:47.501545 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:47.502726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-afc9e69c-64c5-40f7-921d-72898d8c32b0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.167814 Jun 21 03:12:47.503279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 234/470] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:47 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:47.575125 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:47.575739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:47.581791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:47.582414 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:47.583320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:47.583751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:47.615953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:47.624309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d99f42c9-cb1c-42c6-8c32-de787ed7db31 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.387699 Jun 21 03:12:47.624879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 237/471] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:47 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:47.712287 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:47.719821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b47f365d-b1b6-48f1-8f83-3742b9927801 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.150818 Jun 21 03:12:47.720360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 235/472] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:47 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:48.524873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:48.525856 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:48.536844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:48.537323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:48.538082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:48.538511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:48.641742 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:48.642403 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:48.649195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:48.649670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:48.650418 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:48.650844 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:48.681938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:48.690082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:48.691723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:48.692902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f0d672de-0b1e-463e-a4f4-7a551768c9db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.174710 Jun 21 03:12:48.693461 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 238/473] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:48 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:48.737118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:48.737765 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:48.744275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:48.744810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:48.745568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:48.746001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:48.785573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:48.793826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b297cb83-1fb5-43d8-8b19-6cf86dbde0b6 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.155819 Jun 21 03:12:48.794402 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 236/474] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:48 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:48.880101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:48.888141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cb301fe8-7f47-435d-af73-3e4c44343dc6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.154979 Jun 21 03:12:48.888717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 239/475] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:48 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:49.712108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:49.712689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:49.719376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:49.719857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:49.720643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:49.721060 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:49.811051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:49.811649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:49.818586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:49.819035 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:49.819810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:49.820215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:49.856721 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:49.865281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:49.866756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:49.867900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e1ea5a6c-1b5a-47ae-a2af-14bf4286a8c2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.159895 Jun 21 03:12:49.868466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 237/476] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:49 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:49.907041 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:49.907773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:49.914476 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:49.914981 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:49.915775 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:49.916354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:49.949423 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:49.957969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9463f220-ac8e-4b50-8611-b2a98f264d2e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.150717 Jun 21 03:12:49.958519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 240/477] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:49 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:50.051122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:50.058758 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4c77cd6b-21c6-4cca-b038-39ec47198f7e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.155545 Jun 21 03:12:50.059304 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 238/478] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:49 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:50.891198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:50.892180 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:50.895424 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=8 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:50.905388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:50.906126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:50.907950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:50.908099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:50.975700 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:50.976265 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:50.978398 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:50.979219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:50.986148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:50.986609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:50.987369 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:50.987853 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:51.046463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:51.055747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:51.057277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:51.058429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6196e09b-7b59-497c-a149-29eb376fe186 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.173898 Jun 21 03:12:51.058985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 241/479] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:50 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:51.075386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:51.075903 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:51.082752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:51.083237 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:51.084002 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:51.084473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:51.224005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:51.232082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1fc031bf-be5d-4c93-b8ec-32dbe9acfe64 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.160580 Jun 21 03:12:51.232655 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 242/480] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:51 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:51.353007 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:51.362240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-13e9ad62-c051-4260-9de5-ba87c33c1f0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.390563 Jun 21 03:12:51.362965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 239/481] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:50 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:52.077079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:52.077680 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:52.084472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:52.084913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:52.085663 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:52.086082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:52.223641 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:52.231723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:52.233228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:52.234384 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-93cacf4a-05c7-43ba-aba9-310d42307128 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.161268 Jun 21 03:12:52.234933 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 243/482] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:52 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:52.251292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:52.252012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:52.259244 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:52.259702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:52.260467 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:52.260920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:52.380434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:52.381061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:52.387437 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:52.387876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:52.388661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:52.389087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:52.396004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:52.404003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a3260a52-ff41-4766-8678-0c51be699b40 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.157698 Jun 21 03:12:52.405526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 240/483] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:52 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:52.524774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:52.536497 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f3207de6-ce21-42e8-950a-47494542c175 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.159650 Jun 21 03:12:52.537353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 244/484] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:52 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:12:53.257272 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:53.258275 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:53.269410 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.269862 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.270619 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.271112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.403007 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:53.410900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:53.412371 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:53.413544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6b1d0dd3-1c64-4886-b040-407ac539f384 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.163231 Jun 21 03:12:53.414095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 241/485] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:53 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:53.422722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:53.423332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:53.430393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.430839 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.431590 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.432021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.558582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:53.559204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:53.565366 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.565949 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.567233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.567662 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.575595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:53.583578 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-eb3af297-aa0f-4074-ab66-61f249bf6929 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.164668 Jun 21 03:12:53.584128 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 245/486] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:53 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:53.701666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:53.710041 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3edd430d-b6de-4909-aedc-e42f0c19e606 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.155244 Jun 21 03:12:53.710808 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 242/487] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:53 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:12:53.928588 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-ecbe279c-96a5-41ee-9c78-45d205d2af0a req-cd697d77-0ec3-4eb8-97bd-ac51c2fd19fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ebc898-2fa4-4c13-b321-a788afa0bd84", "name": "network-vif-plugged", "status": "completed", "tag": "609de0d2-a25b-4db4-a7ec-dd2c6422bb8b"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:53.937855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-ecbe279c-96a5-41ee-9c78-45d205d2af0a req-cd697d77-0ec3-4eb8-97bd-ac51c2fd19fd service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:53.938404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-ecbe279c-96a5-41ee-9c78-45d205d2af0a req-cd697d77-0ec3-4eb8-97bd-ac51c2fd19fd service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:53.950594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-ecbe279c-96a5-41ee-9c78-45d205d2af0a req-cd697d77-0ec3-4eb8-97bd-ac51c2fd19fd service nova] Creating event network-vif-plugged:609de0d2-a25b-4db4-a7ec-dd2c6422bb8b for instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 on hv-cinder-84684 Jun 21 03:12:53.955751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-ecbe279c-96a5-41ee-9c78-45d205d2af0a req-cd697d77-0ec3-4eb8-97bd-ac51c2fd19fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031235 Jun 21 03:12:53.956440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 246/488] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:54.435949 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:54.436914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:54.445970 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:54.446414 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:54.447174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:54.447606 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:54.589380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:54.597990 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:54.599485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:54.600671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ca6a42b5-294e-4b08-aa6d-1a26c5dfd680 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.171315 Jun 21 03:12:54.601213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 243/489] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:54 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:54.601588 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:54.602276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:54.609673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:54.610116 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:54.610860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:54.611282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:54.615255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:54.727238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:54.728171 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:54.735320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:54.735784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:54.737077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:54.737567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:54.765112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:54.774600 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8252eb4f-1eec-44f6-8567-49269da78a57 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.177807 Jun 21 03:12:54.783891 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 247/490] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:54 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:54.876465 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:54.888544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7491fcf4-db8c-4a0b-a33d-cb3c98a918bb tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.164952 Jun 21 03:12:54.889383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 244/491] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:54 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:55.619212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:55.619812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:55.627096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.627537 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:55.628457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.628894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:55.768909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:55.777266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:55.778775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:55.779919 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fb913c76-a9b0-4a03-afa8-33464088e327 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.164718 Jun 21 03:12:55.780498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 248/492] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:55 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:55.792027 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:55.793335 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:55.799708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.800707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:55.801693 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.802303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:55.907337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:55.908110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:55.914865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.915382 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:55.916304 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.916860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:55.937511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:55.945879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-80d833e1-ef45-4364-b71d-da358aa68b9d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.158314 Jun 21 03:12:55.946420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 245/493] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:55 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:55.981402 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-63ed619d-e583-4a7c-a847-4bb4182eeb58 req-d6c6558a-15c3-4e4c-9d8d-bbdd09709d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "name": "network-vif-plugged", "status": "completed", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:55.990514 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-63ed619d-e583-4a7c-a847-4bb4182eeb58 req-d6c6558a-15c3-4e4c-9d8d-bbdd09709d0c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:55.990953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-63ed619d-e583-4a7c-a847-4bb4182eeb58 req-d6c6558a-15c3-4e4c-9d8d-bbdd09709d0c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:56.002687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-63ed619d-e583-4a7c-a847-4bb4182eeb58 req-d6c6558a-15c3-4e4c-9d8d-bbdd09709d0c service nova] Creating event network-vif-plugged:a6a84e7e-f693-4251-bff2-a21fced5ba19 for instance bade48e3-65d3-406d-8d36-53e1f560e554 on hv-cinder-84684 Jun 21 03:12:56.008650 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-63ed619d-e583-4a7c-a847-4bb4182eeb58 req-d6c6558a-15c3-4e4c-9d8d-bbdd09709d0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030857 Jun 21 03:12:56.009235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 246/494] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:56.059079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:56.069621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1a1a7c8f-e6ac-4c31-bd98-dc0fae263de5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.166079 Jun 21 03:12:56.070195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 249/495] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:55 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:12:56.798743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:56.799446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:56.808916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:56.809353 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:56.810385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:56.811089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:56.950063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:56.955143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:56.961127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:56.962601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:56.962907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:56.963501 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:56.963818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5dc8e45b-d832-494b-b1c9-01cf28b61707 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.169839 Jun 21 03:12:56.964363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 247/496] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:56 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:56.969908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:56.970344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:56.971078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:56.971499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:57.087644 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:57.088250 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:57.091150 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:57.094839 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:57.095279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:57.096061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:57.096490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:57.108157 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:57.116231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f0310354-f982-4f52-b265-1565d2ccf86a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1367 microversion: 2.1 time: 0.157039 Jun 21 03:12:57.116818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 250/497] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:56 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:12:57.236274 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:57.244697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-71903dc7-bfa2-4d00-9d09-d64aba03ccba tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.161145 Jun 21 03:12:57.245264 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 248/498] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:57 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:57.982943 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:57.983585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:57.990113 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:57.990557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:57.991315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:57.991742 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.126324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:58.133779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:58.134482 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:58.135075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:58.136599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:58.137758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-17aeca6a-a75b-46b6-80ed-27387b7b9151 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.159517 Jun 21 03:12:58.138314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 251/499] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:57 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:58.143308 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:58.143759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.144738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:58.145180 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.263007 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:58.263643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:58.265593 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:12:58.271487 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:58.271930 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.272733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:58.273163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.285517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:58.293446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-06c6a6e5-fad0-47af-9213-a8ea8fb11c70 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1556 microversion: 2.1 time: 0.163433 Jun 21 03:12:58.294014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 249/500] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:58 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:58.309692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:58.310252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:58.316773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:58.317279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.318148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:58.318635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:58.401630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-df1e4d7d-fa7b-4cfb-b15d-fa9ca653d5cc tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095679 Jun 21 03:12:58.402375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:12:58 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:12:58.408178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:58.416555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8a4f0582-8234-406b-af8d-6cec53223340 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.157595 Jun 21 03:12:58.417164 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:58 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:12:59.158387 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:59.158940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:59.166188 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:59.167060 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:59.167456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:59.167879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:59.310769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:59.319115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:59.320637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:59.321791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d7fc19b-e77c-4869-aa81-74da62062f31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1744 microversion: 2.20 time: 0.169043 Jun 21 03:12:59.322340 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 251/503] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:12:59 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:12:59.433425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:12:59.434105 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:12:59.441511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:59.441959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:59.442740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:59.443178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:59.827326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-408b72c6-448e-4fa2-a55a-215e2bcdc1ec req-4d10f7af-3011-4d8a-8f71-aa39598fd1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ebc898-2fa4-4c13-b321-a788afa0bd84", "tag": "609de0d2-a25b-4db4-a7ec-dd2c6422bb8b"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:12:59.836592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-408b72c6-448e-4fa2-a55a-215e2bcdc1ec req-4d10f7af-3011-4d8a-8f71-aa39598fd1a8 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:12:59.837037 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-408b72c6-448e-4fa2-a55a-215e2bcdc1ec req-4d10f7af-3011-4d8a-8f71-aa39598fd1a8 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:12:59.848059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-408b72c6-448e-4fa2-a55a-215e2bcdc1ec req-4d10f7af-3011-4d8a-8f71-aa39598fd1a8 service nova] Creating event network-changed:609de0d2-a25b-4db4-a7ec-dd2c6422bb8b for instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 on hv-cinder-84684 Jun 21 03:12:59.851250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:12:59.853244 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-408b72c6-448e-4fa2-a55a-215e2bcdc1ec req-4d10f7af-3011-4d8a-8f71-aa39598fd1a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 Jun 21 03:12:59.854503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 252/504] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:12:59.860048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fb37ebce-bc5b-4c14-8c09-8490ebcae012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.430502 Jun 21 03:12:59.860610 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 253/505] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:12:59 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:00.340983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:00.341680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:00.348609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:00.349030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:00.349965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:00.350620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:00.583272 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:00.592025 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:00.593609 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:00.595512 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-049ce815-3f7d-4cb1-8fd4-1b796ab3f35b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.259553 Jun 21 03:13:00.605222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 253/506] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:00 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:00.877708 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:00.879625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:00.886862 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:00.887526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:00.888810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:00.889029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:01.033875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:01.043017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-bd5d53ac-1ebc-48b9-b1f1-95784bdb7474 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.168957 Jun 21 03:13:01.044051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 254/507] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:00 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:01.615001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:01.615595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:01.622695 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:01.623139 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:01.623946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:01.624604 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:01.771989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:01.780533 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:01.782066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:01.783232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff87594c-d2ac-42a4-acd1-db3ea6c15da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.172589 Jun 21 03:13:01.783921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 254/508] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:01 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:02.062769 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:02.064291 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:02.073157 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:02.073892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:02.074857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:02.075449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:02.234050 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:02.243442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-77666d7e-0cc1-42b1-82a5-6e6aabb24c0e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.186198 Jun 21 03:13:02.244106 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:02 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:02.801529 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:02.802158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:02.809448 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:02.810158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:02.811113 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:02.811543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:02.972569 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:02.981013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:02.982815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:02.984034 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0eda0e75-d4dd-4942-aa06-e3176a04abe7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.186541 Jun 21 03:13:02.984558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 255/510] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:02 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:03.262523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:03.263177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:03.270485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:03.271190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:03.272139 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:03.272864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:03.420614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:03.430754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-57ec5f79-99ed-4c56-bc5a-5ae43201c360 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.171952 Jun 21 03:13:03.431340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 256/511] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:03 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:04.003898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:04.005392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:04.012249 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:04.012843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:04.013629 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:04.014294 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:04.184462 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:04.194410 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:04.196093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:04.197409 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-653deb47-ae4f-4395-988b-05fa8dea2727 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.197873 Jun 21 03:13:04.198038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 256/512] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:03 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:04.447464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:04.448778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:04.457736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:04.458280 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:04.459446 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:04.459950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:04.598217 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:04.609953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-42cff265-7dfe-47f5-b551-0899a7fba798 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.166133 Jun 21 03:13:04.623463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 257/513] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:04 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:05.216084 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:05.217512 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:05.224528 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:05.224975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:05.225731 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:05.226175 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:05.376308 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:05.387312 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:05.389253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:05.390582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b30f9455-cd0b-422e-b898-ee977fd4d9d6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.178464 Jun 21 03:13:05.391139 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 257/514] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:05 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:05.629821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:05.631261 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:05.639271 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:05.639801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:05.640698 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:05.641362 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:05.796559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:05.807125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-65a13133-1eda-4240-a239-652fcf6bdb07 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.181120 Jun 21 03:13:05.818904 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 258/515] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:05 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:06.410778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:06.411618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:06.418904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:06.419407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:06.420347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:06.420835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:06.566661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:06.576046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:06.577687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:06.578900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-21c1d759-119c-4aed-ac19-6b567cd595f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.173164 Jun 21 03:13:06.589896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 258/516] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:06 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:06.828894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:06.830334 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:06.839514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:06.840338 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:06.841223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:06.841727 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:07.014924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:07.024337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f64691af-42fb-4a40-ad4b-234997e9a787 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.201580 Jun 21 03:13:07.034562 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 259/517] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:06 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:07.597823 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:07.598454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:07.605926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:07.606610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:07.607539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:07.608134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:07.788491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:07.796933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:07.798438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:07.799611 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-adce1b6b-81b1-4738-a435-0bc78cbf4b31 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.205896 Jun 21 03:13:07.800465 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 259/518] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:07 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:13:08.042250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:08.042855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:08.049050 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:08.052119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:08.053285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:08.053745 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:08.202857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:08.213163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-02c35b5b-eeec-4dc8-8bd3-3adaff44d209 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.174015 Jun 21 03:13:08.213750 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 260/519] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:08 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:08.818771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:08.819424 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:08.826655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:08.827123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:08.827877 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:08.828305 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:08.979357 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:08.987518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:08.989029 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:08.990174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8297aa71-a5f4-4ecb-96bb-34cacdf8c38e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.175538 Jun 21 03:13:08.990729 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 260/520] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:08 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:09.230976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:09.231789 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:09.239080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:09.239539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:09.240303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:09.240761 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:09.394503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:09.403889 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-95829de6-168c-4ab9-a0e6-cf8f883107ab tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.176848 Jun 21 03:13:09.410970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 261/521] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:09 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:10.009161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:10.009717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:10.016804 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:10.017254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:10.018012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:10.018487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:10.161336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:10.169657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:10.171130 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:10.172276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d3633d7d-82c5-4827-a79e-833f39a85091 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.167118 Jun 21 03:13:10.172857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 261/522] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:10 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:10.427248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:10.428226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:10.439155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:10.439901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:10.441215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:10.441649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:10.578374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:10.587271 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-619456f6-2f16-4eb9-933d-ee3057092d57 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.167067 Jun 21 03:13:10.587829 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 262/523] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:10 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:11.191270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:11.191870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:11.198770 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:11.199212 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:11.199961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:11.200384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:11.357361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:11.365513 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:11.366988 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:11.368159 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-188c4b00-6cea-412c-9552-73710442a06e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.181296 Jun 21 03:13:11.368751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 262/524] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:11 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:11.611583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:11.612639 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:11.624905 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:11.626180 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:11.627852 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:11.628530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:11.770884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:11.774320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:11.779399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-49040db1-a6a3-4674-9024-77b5204f8684 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1722 microversion: 2.1 time: 0.174691 Jun 21 03:13:11.779948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 263/525] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:11 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:12.396731 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:12.397704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:12.408693 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:12.409495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:12.410424 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:12.410852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:12.562807 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:12.571834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:12.573360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:12.574508 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c88d08a9-093e-42e1-9ebd-67755efc28e1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1739 microversion: 2.20 time: 0.184315 Jun 21 03:13:12.575069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 263/526] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:12 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:12.801075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:12.801617 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:12.808386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:12.808887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:12.809631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:12.810089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:12.943023 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:12.951814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e865bd91-50d8-4c8c-b4cd-0e7605872eef tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1699 microversion: 2.1 time: 0.156949 Jun 21 03:13:12.952845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 264/527] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:12 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:12.973387 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6092a14f-c77d-4521-bac4-a6a7e377af4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:13:12.979904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6092a14f-c77d-4521-bac4-a6a7e377af4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:12.980570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6092a14f-c77d-4521-bac4-a6a7e377af4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:13.039236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6092a14f-c77d-4521-bac4-a6a7e377af4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Going to try to start instance {{(pid=117664) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 03:13:13.065003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:13.087671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6092a14f-c77d-4521-bac4-a6a7e377af4e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action" status: 202 len: 0 microversion: 2.1 time: 0.118545 Jun 21 03:13:13.088292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 264/528] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:13:12 2022] POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:13:13.097692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:13.098260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:13.104401 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:13.104874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:13.105618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:13.106022 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:13.239155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:13.247462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-001c6a7f-b7a1-4aa8-9310-367e69bf0749 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1708 microversion: 2.1 time: 0.153344 Jun 21 03:13:13.247994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 265/529] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:13 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:13.597768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:13.598911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:13.609520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:13.610232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:13.611480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:13.612207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:13.840985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:13.854049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:13.855936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:13.857174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e7aee8b1-161a-4e06-871f-998a5441f9e5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1721 microversion: 2.20 time: 0.267163 Jun 21 03:13:13.857720 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 265/530] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:13 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:14.269936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:14.270505 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:14.276921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:14.277367 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:14.278146 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:14.278574 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:14.420563 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:14.428793 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c81c2adb-566e-46ea-bb2a-97837b1abd87 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1708 microversion: 2.1 time: 0.165868 Jun 21 03:13:14.429358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 266/531] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:14 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:14.876004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:14.876638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:14.883711 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:14.884553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:14.885632 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:14.886070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:15.025237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:15.039058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:15.041485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:15.043293 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ad43a290-8ffb-4b76-a638-485ae1e16aee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1721 microversion: 2.20 time: 0.171233 Jun 21 03:13:15.044071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 266/532] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:14 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:15.450554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:15.451460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:15.463260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:15.464001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:15.465720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:15.466458 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:15.598928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:15.606887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6dd10ed9-9f8d-4a6b-8495-17ffda05ae59 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1708 microversion: 2.1 time: 0.162878 Jun 21 03:13:15.607453 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 267/533] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:15 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:16.065879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:16.066460 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:16.073346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:16.073782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:16.074528 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:16.074949 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:16.209782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:16.217941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:16.219411 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:16.220591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-908aa70d-da39-4e2c-98b7-6d11a97680fb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1721 microversion: 2.20 time: 0.161046 Jun 21 03:13:16.221146 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 267/534] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:16 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:16.261033 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:16.261969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:16.274991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:16.275407 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:16.276277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:16.276908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:16.409309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lazy-loading 'services' on Instance uuid ef3aeadc-9008-4eed-ac47-2492213bf82f {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:13:16.524697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e47763d1-aa3e-45e7-9fc2-eea66ee1455a tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f/os-volume_attachments/226c6e85-a427-4f2e-8462-0bc01ad6f080" status: 202 len: 0 microversion: 2.1 time: 0.267474 Jun 21 03:13:16.525442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 268/535] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:13:16 2022] DELETE /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f/os-volume_attachments/226c6e85-a427-4f2e-8462-0bc01ad6f080 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:13:16.625120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:16.625633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:16.632005 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:16.632466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:16.633215 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:16.633640 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:16.773854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:16.786795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-09253031-eca9-4a5c-afc0-976d24e86401 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1708 microversion: 2.1 time: 0.165705 Jun 21 03:13:16.787618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 268/536] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:16 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:17.240032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:17.240744 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:17.247853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.248301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.249091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.249549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.393000 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:17.401299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:17.402794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:17.403948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3163443d-71ce-4c7b-87ae-6db53af4608f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1664 microversion: 2.20 time: 0.168292 Jun 21 03:13:17.404496 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 269/537] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:17 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:17.421702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1b0d310-4980-4cbc-8196-552e4faf7928"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:13:17.422700 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:17.429746 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.430184 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.430929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.431358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.735925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-58c888a8-1d18-4131-b57a-252048c79252 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318183 Jun 21 03:13:17.736571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 269/538] 10.222.0.16 () {62 vars in 1363 bytes} [Tue Jun 21 03:13:17 2022] POST /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:13:17.806334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-d395ebe0-bc97-4042-a19c-31364193b248 req-3b9c9baa-8373-4f77-a314-67ba46834696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "name": "network-vif-unplugged", "status": "completed", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:13:17.806568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:17.807204 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:17.816762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d395ebe0-bc97-4042-a19c-31364193b248 req-3b9c9baa-8373-4f77-a314-67ba46834696 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.817071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.817393 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d395ebe0-bc97-4042-a19c-31364193b248 req-3b9c9baa-8373-4f77-a314-67ba46834696 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.817667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.818697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.818869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.831111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.compute.server_external_events [req-d395ebe0-bc97-4042-a19c-31364193b248 req-3b9c9baa-8373-4f77-a314-67ba46834696 service nova] Unable to find a host for instance bade48e3-65d3-406d-8d36-53e1f560e554. Dropping event network-vif-unplugged {{(pid=117664) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 03:13:17.832251 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-d395ebe0-bc97-4042-a19c-31364193b248 req-3b9c9baa-8373-4f77-a314-67ba46834696 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030777 Jun 21 03:13:17.833460 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 270/539] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 03:13:17.863009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:13:17.863815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:17.869887 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.870326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.871074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.871495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.958234 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:17.963227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f2b78f20-d1ba-46a9-87f4-4fd8b0c1c1a6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/action" status: 202 len: 0 microversion: 2.20 time: 0.103492 Jun 21 03:13:17.964033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 271/540] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jun 21 03:13:17 2022] POST /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 03:13:17.966928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c68db1a0-b4c3-4f28-8eb1-4e809ca35d73 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1712 microversion: 2.1 time: 0.165262 Jun 21 03:13:17.977909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 270/541] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:17 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1712 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:17.978095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:17.978095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:17.979231 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.980163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:17.980443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:17.980907 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:18.115337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:18.124782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:18.126280 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:18.127441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-19b23729-2152-4d62-9e6b-506e6ea845ee tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1750 microversion: 2.20 time: 0.159593 Jun 21 03:13:18.127997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 272/542] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:17 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:13:19.146370 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:19.146910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:19.154059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:19.154504 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:19.155262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:19.155685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:19.297295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:19.306888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:19.308374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:19.309835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-67e15811-9f28-4197-874e-1d68ae1bda6f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1750 microversion: 2.20 time: 0.168036 Jun 21 03:13:19.310412 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 271/543] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:19 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:19.762421 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:19.762995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:19.770520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:19.770968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:19.771722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:19.772661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:19.798361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:13:19.894941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0afb2675-8b76-4dc8-afa7-5b6a02353d3c tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 204 len: 0 microversion: 2.1 time: 0.136198 Jun 21 03:13:19.895530 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 273/544] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:13:19 2022] DELETE /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:13:19.904483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:19.905210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:19.911754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:19.912200 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:19.913310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:19.913818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:20.056335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:20.063980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ab853135-596b-4cbf-a229-df138ac23cab tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1513 microversion: 2.1 time: 0.163995 Jun 21 03:13:20.064575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 272/545] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:19 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:20.332149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:20.332767 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:20.339363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:20.339809 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:20.340605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:20.341053 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:20.474610 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:20.483298 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:20.484825 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:20.485963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f0384cea-891f-4330-ae24-b4caf74c94fd tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1752 microversion: 2.20 time: 0.160661 Jun 21 03:13:20.486515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 274/546] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:20 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:21.083501 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:21.084204 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:21.092182 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:21.092734 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:21.093644 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:21.094143 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:21.234256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:21.242376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ea1beb69-78de-4961-982e-3744d3ba1be5 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1513 microversion: 2.1 time: 0.164452 Jun 21 03:13:21.242939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 273/547] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:21 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:21.505259 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:21.505839 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:21.512236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:21.512706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:21.513434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:21.513867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:21.654148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:21.662917 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:21.664401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:21.665579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ad93ab04-91fa-4f01-ba07-6f8d62a5d450 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1752 microversion: 2.20 time: 0.164278 Jun 21 03:13:21.666161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 275/548] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:21 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:22.264070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:22.265111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:22.276187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:22.277232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:22.278485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:22.279211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:22.426372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:22.434234 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fad6c248-2a82-48ff-9f30-32643f63f522 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1513 microversion: 2.1 time: 0.176683 Jun 21 03:13:22.434794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 274/549] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:22 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:22.684739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:22.685932 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:22.693454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:22.693871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:22.694815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:22.695451 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:22.714954 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:22.910496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:22.919189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:22.920704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:22.921861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-43b0ec21-afea-426c-b7eb-ec6a17b76e7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.241438 Jun 21 03:13:22.922646 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 276/550] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:22 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:23.092150 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-3f78a1a4-d571-4b83-b4b1-6315b72adadc req-683836f9-1699-4111-b6a8-20bf6a11f509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3aeadc-9008-4eed-ac47-2492213bf82f", "name": "network-vif-deleted", "tag": "de74322d-b2b1-4e78-983e-9e4f65495959"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:13:23.100445 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-3f78a1a4-d571-4b83-b4b1-6315b72adadc req-683836f9-1699-4111-b6a8-20bf6a11f509 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:23.100687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-3f78a1a4-d571-4b83-b4b1-6315b72adadc req-683836f9-1699-4111-b6a8-20bf6a11f509 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:23.111499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-3f78a1a4-d571-4b83-b4b1-6315b72adadc req-683836f9-1699-4111-b6a8-20bf6a11f509 service nova] Creating event network-vif-deleted:de74322d-b2b1-4e78-983e-9e4f65495959 for instance ef3aeadc-9008-4eed-ac47-2492213bf82f on hv-cinder-84684 Jun 21 03:13:23.116180 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-3f78a1a4-d571-4b83-b4b1-6315b72adadc req-683836f9-1699-4111-b6a8-20bf6a11f509 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027658 Jun 21 03:13:23.116880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 275/551] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:13:23.455266 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:23.456241 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:23.463138 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:23.463585 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:23.464337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:23.464802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:23.496920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:23.497675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:23.498122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lazy-loading 'fault' on Instance uuid ef3aeadc-9008-4eed-ac47-2492213bf82f {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:13:23.545313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0e5c4a49d84ab9ab4c2db7d09e6fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e2178a3c84520ac00fc1cf2da0329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:23.553934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c99f144c-13aa-405c-983c-3b3c3d712d14 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 200 len: 1309 microversion: 2.1 time: 0.105647 Jun 21 03:13:23.554487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 277/552] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:23 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:13:23.942150 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:23.943002 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:23.954802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:23.955373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:23.969681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:23.970502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:24.134170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:24.148280 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:24.149816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:24.151305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-eea2f7ac-07c0-45c7-a53b-48d1eab27631 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.214497 Jun 21 03:13:24.152020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 276/553] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:23 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:24.573723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:24.574833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] [instance: ef3aeadc-9008-4eed-ac47-2492213bf82f] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:24.581903 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:24.582345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:24.583105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:24.583539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:24.600296 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] HTTP exception thrown: Instance ef3aeadc-9008-4eed-ac47-2492213bf82f could not be found. Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Request method failure captured: Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f HTTP/1.1 Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTa3rLv8Me3JDkVBHESCFN1xbMRvRaM61TMkJBGp4CJjdEEzj7WQFAqHVIsspyCVktLhzi2sTuh5DbBMWiL1dTi64a2UvCJ5bouJ1cICz4K0dqh3iUpywj5gQlTHw0r_MlJBIqnR-Ju4o6mJ_sgnYH1NRrizsa9mfSXUlX5rourthiw Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 0d8e2178a3c84520ac00fc1cf2da0329 Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1727898766 Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:13:24.601998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8e2178a3c84520ac00fc1cf2da0329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8e2178a3c84520ac00fc1cf2da0329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8e2178a3c84520ac00fc1cf2da0329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8e2178a3c84520ac00fc1cf2da0329", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotTestJSON-1727898766 Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 0d8e2178a3c84520ac00fc1cf2da0329 Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1727898766 Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotTestJSON-1727898766-project Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 4d0e5c4a49d84ab9ab4c2db7d09e6fac Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotTestJSON-1727898766-project Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance ef3aeadc-9008-4eed-ac47-2492213bf82f could not be found. Jun 21 03:13:24.603386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'ef3aeadc-9008-4eed-ac47-2492213bf82f'} Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3aeadc-9008-4eed-ac47-2492213bf82f could not be found. Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:13:24.604177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3aeadc-9008-4eed-ac47-2492213bf82f could not be found. Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3aeadc-9008-4eed-ac47-2492213bf82f could not be found. Jun 21 03:13:24.605924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:13:24.607103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] Returning 404 to user: Instance ef3aeadc-9008-4eed-ac47-2492213bf82f could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:13:24.607103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e071c68-42fb-4610-8f9e-08923882b6a4 tempest-VolumesSnapshotTestJSON-1727898766 tempest-VolumesSnapshotTestJSON-1727898766-project] 10.222.0.16 "GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f" status: 404 len: 111 microversion: 2.1 time: 0.036302 Jun 21 03:13:24.607103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 278/554] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:13:24 2022] GET /compute/v2.1/servers/ef3aeadc-9008-4eed-ac47-2492213bf82f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:13:25.169125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:25.169727 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:25.177344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:25.177625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:25.178371 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:25.178795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:25.313532 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:25.322433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:25.323896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:25.325075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a38bc9da-bcc9-4e03-b9ef-bf2804fdc7d4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.159936 Jun 21 03:13:25.325623 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 277/555] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:25 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:26.343468 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:26.344093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:26.351197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:26.351675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:26.352477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:26.352871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:26.496226 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:26.505880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:26.507382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:26.508588 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cd70510a-4842-47ac-a0b1-7226de57387b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.169177 Jun 21 03:13:26.509141 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 279/556] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:26 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:27.527207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:27.528636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:27.536796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:27.537277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:27.538206 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:27.538697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:27.679609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:27.688898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:27.690548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:27.691949 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-904bd3d1-dfe3-4819-b2d4-cf126824b845 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.168492 Jun 21 03:13:27.692528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 278/557] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:27 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:28.712684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:28.713441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:28.716334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:28.723238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:28.723792 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:28.724769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:28.725314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:28.871086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:28.880595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:28.882087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:28.883239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-05b0918a-2876-4c7e-b8c5-ac221c55304b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.175637 Jun 21 03:13:28.883795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 280/558] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:28 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:29.901709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:29.902357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:29.904786 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=54 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:29.911191 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:29.911668 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:29.912443 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:29.912881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:30.049260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:30.057952 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:30.059434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:30.060619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0172df73-3238-4993-ae99-e708b9afeb57 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.162814 Jun 21 03:13:30.061144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 279/559] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:29 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:31.079057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:31.081148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:31.091013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:31.091575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:31.092453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:31.092940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:31.261720 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:31.277811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:31.279313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:31.280588 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c53f2a85-e421-4dcd-9305-ffd558d6c475 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.205423 Jun 21 03:13:31.281318 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 281/560] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:31 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:32.303205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:32.303205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:32.315479 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:32.316097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:32.316938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:32.317375 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:32.343898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:32.458491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:32.467570 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:32.469095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:32.470264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6822641d-a75f-489a-9f90-968537fad87f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.171976 Jun 21 03:13:32.475244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 280/561] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:32 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:33.489497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:33.490214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:33.496869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:33.497622 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:33.498381 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:33.498807 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:33.652273 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:33.662367 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:33.664022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:33.665419 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5c1fcb06-1015-4097-b4af-5039371deed1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.180033 Jun 21 03:13:33.666047 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 282/562] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:33 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:34.683166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:34.683760 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:34.691124 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:34.691642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:34.692424 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:34.692891 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:34.833836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:34.842511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:34.843992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:34.845613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9d35cf01-0351-4c2b-b9b8-eaf9e08ca9c0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.166551 Jun 21 03:13:34.846216 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 281/563] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:34 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:35.863883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:35.864569 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:35.871217 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:35.871662 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:35.872766 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:35.873198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:36.015469 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:36.026637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:36.028140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:36.029347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-74ba4413-1bbb-464e-bbf7-28d653547de8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.170156 Jun 21 03:13:36.029907 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 283/564] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:35 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:37.049130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:37.049801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:37.057742 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:37.058185 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:37.058932 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:37.059358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:37.198434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:37.207269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:37.208768 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:37.209910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1ad59a04-aa07-45db-84eb-929d46c3cde9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.165010 Jun 21 03:13:37.210477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 282/565] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:37 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:38.229044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:38.229759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:38.241961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:38.242671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:38.243696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:38.244329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:38.418060 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:38.428064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:38.430341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:38.431481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-de5107cd-64bf-4ae7-9d30-df4bb2b6479d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.207095 Jun 21 03:13:38.432045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 284/566] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:38 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:39.451030 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:39.451613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:39.458611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:39.459053 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:39.459777 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:39.460203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:39.598555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:39.607233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:39.608741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:39.609896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7a65f3f1-d466-4699-828b-29c530e30083 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.162870 Jun 21 03:13:39.610439 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 283/567] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:39 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:40.629576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:40.630164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:40.636834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:40.637276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:40.638028 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:40.638459 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:40.781033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:40.794446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:40.796935 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:40.798772 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cd7b23d2-e6a8-4894-8658-2abcc524d636 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.173120 Jun 21 03:13:40.799608 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 285/568] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:40 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:41.819463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:41.820153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:41.829069 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:41.829651 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:41.830983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:41.831873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:42.029115 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:42.038311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:42.039780 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:42.040959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7d3d3f83-f551-4269-85fa-0b7e5b1a6b3d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.226876 Jun 21 03:13:42.041507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 284/569] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:41 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:43.063219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:43.064196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:43.071573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:43.072020 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:43.072826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:43.073260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:43.210220 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:43.220593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:43.222256 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:43.223437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fe7a26f9-7b4b-4bd4-9c14-1255f251e658 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.166717 Jun 21 03:13:43.224024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 286/570] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:43 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:44.250015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:44.251021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:44.261650 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:44.262386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:44.263606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:44.264348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:44.407904 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:44.420681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:44.422967 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:44.424513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-554f9583-7ddc-46c0-a32a-f2d170beaa3c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.181197 Jun 21 03:13:44.425078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 285/571] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:44 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:45.445210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:45.445911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:45.455321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:45.455985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:45.456957 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:45.457558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:45.677989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:45.686902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:45.688517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:45.689753 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-21869a49-8ecb-4ca5-890f-8d51f9ca3860 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.250008 Jun 21 03:13:45.690367 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 287/572] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:45 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:46.708247 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:46.708926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:46.718515 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:46.719179 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:46.720337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:46.721092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:46.858883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:46.867458 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:46.869077 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:46.870239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fd973d50-4dd4-475b-95e2-4488d4beea95 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.166887 Jun 21 03:13:46.870779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 286/573] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:46 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:47.892570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:47.893584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:47.904478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:47.905258 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:47.906497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:47.907204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:48.050151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:48.058538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:48.060061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:48.061253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4e5a21b7-96df-4319-9d24-3f3b3bb384fe tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.175064 Jun 21 03:13:48.061796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 288/574] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:47 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:13:49.082795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:49.083685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:49.094547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:49.095305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:49.096639 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:49.097077 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:49.237195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:49.245938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:49.247757 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:49.248963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-246634e9-6ed1-4c5c-98a3-9660a5352e2e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.172768 Jun 21 03:13:49.249516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 287/575] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:49 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:50.271248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:50.271991 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:50.280773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:50.281328 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:50.282307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:50.282846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:50.422769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:50.432194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:50.433716 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:50.434866 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b663aad3-e15d-4cc3-8615-ca6ab4b3a060 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.169811 Jun 21 03:13:50.435393 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 289/576] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:50 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:51.457348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:51.458247 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:51.469160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:51.469887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:51.471136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:51.471982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:51.625111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:51.634104 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:51.635592 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:51.636775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b09c8d2a-04f6-4fe7-b612-a12ea4984a8e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.185966 Jun 21 03:13:51.637327 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 288/577] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:51 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:52.658793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:52.659838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:52.671138 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:52.671864 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:52.673203 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:52.673928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:52.808909 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:52.811115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=83 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:52.818558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:52.820040 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:52.821214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-57e15355-91bd-43ba-bff1-6b35ee5d0df5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.168945 Jun 21 03:13:52.821769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 290/578] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:52 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:53.843330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:53.844249 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:53.852301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:53.852779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:53.853520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:53.853939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:53.984955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:53.993849 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:53.995340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:53.996575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3479c638-ce0d-40a0-a18e-9f4696f4811e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.159750 Jun 21 03:13:53.997682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 289/579] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:53 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:55.019169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:55.019826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:55.028112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:55.028675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:55.029582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:55.030076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:55.174856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:55.183217 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:55.184730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:55.185872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ffe052a8-e7c9-42d3-89e8-9a4dde3fda8f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.173351 Jun 21 03:13:55.186427 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 291/580] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:55 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:56.204641 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:56.205306 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:56.212128 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:56.212680 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:56.213519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:56.214049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:56.348569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:56.357107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:56.358607 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:56.359767 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-471d0e98-d69c-4e82-9813-6491f3dcd2a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.159266 Jun 21 03:13:56.360325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 290/581] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:56 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:57.378531 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:57.379268 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:57.386792 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:57.387232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:57.387978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:57.388401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:57.761316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:57.774705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:57.776888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:57.780486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6918537d-24e5-4b87-a8ba-ed71f50f0280 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.404058 Jun 21 03:13:57.780486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 292/582] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:57 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:13:58.108367 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-409e8d92-ae09-4301-898f-3154eababaf4 req-edaeef71-c2ba-49bb-8f80-1948e0733940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "name": "network-vif-plugged", "status": "completed", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:13:58.117236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-409e8d92-ae09-4301-898f-3154eababaf4 req-edaeef71-c2ba-49bb-8f80-1948e0733940 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:58.117743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-409e8d92-ae09-4301-898f-3154eababaf4 req-edaeef71-c2ba-49bb-8f80-1948e0733940 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:58.130643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-409e8d92-ae09-4301-898f-3154eababaf4 req-edaeef71-c2ba-49bb-8f80-1948e0733940 service nova] Creating event network-vif-plugged:a6a84e7e-f693-4251-bff2-a21fced5ba19 for instance bade48e3-65d3-406d-8d36-53e1f560e554 on hv-cinder-84684 Jun 21 03:13:58.135513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-409e8d92-ae09-4301-898f-3154eababaf4 req-edaeef71-c2ba-49bb-8f80-1948e0733940 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Jun 21 03:13:58.136350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 291/583] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:13:58.214079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:13:58.214239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:13:58.983761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:13:58.984328 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:13:58.986278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=26 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:13:58.992227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:58.992699 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:58.993456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:13:58.993867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:13:59.143859 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:59.157648 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:59.159926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:13:59.161119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-35ea51ba-e2bf-404e-825d-318bb54f8c23 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.367538 Jun 21 03:13:59.161673 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 293/584] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:13:58 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:00.182492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:00.183185 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:00.185126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=26 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:00.191171 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:00.191619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:00.192378 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:00.192840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:00.330747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:00.339824 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:00.341360 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:00.342514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8d6b00a5-34bc-4bc3-abc1-76c6207f657c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.164819 Jun 21 03:14:00.343063 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 292/585] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:14:00 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:01.365223 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:01.366155 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:01.377697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:01.378567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:01.379386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:01.379819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:01.527077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:01.535928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:01.537460 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:01.538604 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-202502a4-4308-4c4f-be33-83cd432353f8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.180191 Jun 21 03:14:01.539154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 294/586] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:14:01 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:02.558311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:02.558909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:02.567255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:02.567733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:02.568519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:02.568950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:02.571542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=71 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:02.710043 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:02.718707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:02.720201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:02.721454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8e59974d-559b-42ee-9fd8-b580933e5b50 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.168445 Jun 21 03:14:02.722218 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 293/587] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:14:02 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:03.750283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:03.751372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:03.761980 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:03.762718 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:03.763963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:03.764725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:03.902100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:03.911056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:03.912613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:03.913802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b4daee86-a5bf-49c2-b1d6-3a96affeb1af tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.170641 Jun 21 03:14:03.914357 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 295/588] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:14:03 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:04.874079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23ace432-c0b9-4799-99d8-c14d2e545ee9"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:04.875226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:04.882045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:04.882479 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:04.883223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:04.883650 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:04.931520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:04.932723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:04.940520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:04.942056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:04.942835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:04.943433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:05.109944 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:05.119966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:05.121505 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:05.123054 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1c214f3c-3c87-4cb2-bd6a-b3d21186dc4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1808 microversion: 2.20 time: 0.195308 Jun 21 03:14:05.123645 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 296/589] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:14:04 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:05.235669 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f940d128-a242-481f-a6e0-9d46b3a1719a tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475713 Jun 21 03:14:05.236385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 294/590] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:14:04 2022] POST /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:06.141333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:06.141931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:06.148721 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:06.149204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:06.150027 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:06.150459 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:06.293366 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:06.306380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:06.307941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:06.309118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-82b14309-b1e9-4a66-8d2b-e1d9ebb32a42 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1795 microversion: 2.20 time: 0.171692 Jun 21 03:14:06.309697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 297/591] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:14:06 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1795 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:14:12.784703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:12.786528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:12.797237 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:12.797950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:12.799160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:12.799746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:12.822346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lazy-loading 'flavor' on Instance uuid efe59a7e-b84b-40b7-a271-0e7c697dfc5a {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:14:12.958713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-89a8b881-ca85-442c-a586-4918cb42beef tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/action" status: 200 len: 32 microversion: 2.1 time: 0.181569 Jun 21 03:14:12.959155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 295/592] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:14:12 2022] POST /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:14:12.968497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:12.969106 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:12.976284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:12.976784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:12.977546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:12.977973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:13.114087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:13.122661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c538e4e7-95ca-4811-9e26-1ed996b273bb tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.157705 Jun 21 03:14:13.123253 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 298/593] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:12 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:14.145496 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:14.146626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:14.157503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:14.158264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:14.159768 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:14.160939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:14.296153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:14.304565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7c5da3ca-4481-4aeb-8d11-448a2556d156 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.166953 Jun 21 03:14:14.305102 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 296/594] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:14 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:15.321913 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:15.322486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:15.329675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:15.330124 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:15.330887 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:15.331319 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:15.478285 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:15.487247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f0b7826f-c573-4df7-a83e-3ab2d9516d80 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.169030 Jun 21 03:14:15.487824 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 299/595] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:15 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:16.508793 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:16.509819 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:16.520011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:16.520441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:16.521242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:16.521673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:16.659607 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:16.667787 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e5e91aab-c638-4e21-b35a-669e897128ca tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.165569 Jun 21 03:14:16.668350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 297/596] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:16 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:17.685328 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:17.685929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:17.692866 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:17.693319 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:17.694073 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:17.694506 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:17.831889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:17.844339 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5e262a22-4bc2-4245-9242-8dc8e59eef3d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.162574 Jun 21 03:14:17.845270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 300/597] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:17 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:18.866970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:18.867918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:18.880153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:18.880978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:18.882218 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:18.882934 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:19.027442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:19.037440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7e0c4935-fb65-4977-8548-fa2502f3a22b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.176863 Jun 21 03:14:19.038014 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 298/598] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:18 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:20.056825 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:20.057535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:20.066359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:20.066811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:20.067573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:20.068005 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:20.217801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:20.230106 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0bf7080f-d980-4d1e-9745-e1d12c1b5a13 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.178401 Jun 21 03:14:20.230882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 301/599] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:20 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:21.252320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:21.253369 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:21.265013 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:21.265746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:21.266985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:21.267694 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:21.409547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:21.417545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9a4d2d74-3df2-4b20-b0af-303effaa9f68 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.172105 Jun 21 03:14:21.418107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 299/600] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:21 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:22.445257 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:22.446096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:22.456680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:22.457114 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:22.457878 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:22.458306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:22.600752 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:22.609205 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b7c9f671-e572-4dd9-a94b-4bafdd44f7b6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.170709 Jun 21 03:14:22.609778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 302/601] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:22 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:23.627938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:23.628730 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:23.635679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:23.636118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:23.636899 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:23.637324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:23.765421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:23.774067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-842f3e9c-aa77-4361-b0c9-1fcdb93741bf tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.150749 Jun 21 03:14:23.774624 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 300/602] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:23 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:24.798865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:24.799713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:24.807081 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:24.807549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:24.808346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:24.808835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:24.945984 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:24.954374 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-81dcffc2-35b8-44a6-a858-5e52a0ccf272 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.161959 Jun 21 03:14:24.954942 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 303/603] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:24 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:25.970917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:25.971597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:25.978314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:25.978765 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:25.979514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:25.979940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:26.154206 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:26.171028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6b2062a5-158a-4537-87b4-5dff07647d9d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.203866 Jun 21 03:14:26.171603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 301/604] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:25 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:27.189103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:27.189712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:27.196820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:27.197264 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:27.198014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:27.198447 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:27.200995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=80 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:27.332937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:27.341194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-71ee4305-e29f-4622-a98a-54a966cf71f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1738 microversion: 2.1 time: 0.155992 Jun 21 03:14:27.341763 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 304/605] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:27 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:28.359250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:28.359818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:28.366539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.366982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.367728 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.368172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.503152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:28.511155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0c0eec23-9921-418e-a3d1-28df88b11130 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1718 microversion: 2.1 time: 0.156200 Jun 21 03:14:28.511720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 302/606] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:28 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:28.623735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:28.624267 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:28.631382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.631833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.632633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.633063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.723443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] HTTP exception thrown: Cannot 'detach_volume' instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a while it is in vm_state rescued Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Request method failure captured: Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments/23ace432-c0b9-4799-99d8-c14d2e545ee9 HTTP/1.1 Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZFsE57y111iJ6jScviONiJarz-kohNHNtmD6ZXTo-M9n7SkKUTRGok56P_1k6ps01sUdEqJbv1q355v3rAkFUJhCjf3wx3dONdKixDnhRQ-WupcbXee0O9GhSs-vulJ5vSQERSuGotTDKLgjXri_qgHMkrPo2uz1gwUN5foj0u5pQ Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:14:28.724975 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262f17284a44afaa2b5d2d2db0a3ef6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 8bd2fc9f3216425cbcbbed84b7815529 Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:14:28.726331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Cannot 'detach_volume' instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a while it is in vm_state rescued Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'server_id': 'efe59a7e-b84b-40b7-a271-0e7c697dfc5a', 'id': '23ace432-c0b9-4799-99d8-c14d2e545ee9'} Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:14:28.727006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a while it is in vm_state rescued Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a while it is in vm_state rescued Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:28.728323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Returning 409 to user: Cannot 'detach_volume' instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a while it is in vm_state rescued {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:14:28.729326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3355910d-e2fd-4ba6-a383-99c0e921dac0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments/23ace432-c0b9-4799-99d8-c14d2e545ee9" status: 409 len: 152 microversion: 2.1 time: 0.107012 Jun 21 03:14:28.730314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 305/607] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:14:28 2022] DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments/23ace432-c0b9-4799-99d8-c14d2e545ee9 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 03:14:28.736530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:28.737423 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:28.743946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.744391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.745232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.745660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.816707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-de07bd3b-ca62-4c1f-91f5-eb9d46a4c369 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "POST /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/action" status: 202 len: 0 microversion: 2.1 time: 0.084780 Jun 21 03:14:28.817336 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 303/608] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:14:28 2022] POST /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 03:14:28.825597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:28.826205 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:28.832375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.832836 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.833574 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:28.834006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:28.973598 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:28.981955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-929bf20a-b72e-4146-8ac3-ed24d46bee78 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1726 microversion: 2.1 time: 0.160163 Jun 21 03:14:28.982508 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 306/609] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:28 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:30.005540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:30.006662 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:30.017192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:30.018027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:30.018788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:30.019211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:30.151092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:30.161590 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-84eedcea-2622-4640-ab28-3f7b24f9946b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1726 microversion: 2.1 time: 0.164279 Jun 21 03:14:30.162358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 304/610] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:29 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:31.183184 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:31.183787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:31.186259 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=28 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:31.191932 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:31.192391 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:31.193148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:31.193571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:31.326555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:31.335217 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3d2f4f69-b48c-4309-a045-3027f5501a04 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1726 microversion: 2.1 time: 0.156302 Jun 21 03:14:31.335789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:31 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:32.354613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:32.356254 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:32.358752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=26 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:32.364378 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:32.364844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:32.365595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:32.366019 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:32.381708 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:32.523619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:32.537547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-696b8934-53ab-443d-b481-44998405c81d tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1732 microversion: 2.1 time: 0.188218 Jun 21 03:14:32.538137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 305/612] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:32 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:32.556627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:32.557201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:32.563595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:32.564043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:32.564974 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:32.565543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:32.655166 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-33ec5208-7fb4-4102-b934-c46ef4f972b2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103107 Jun 21 03:14:32.656174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 308/613] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:14:32 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:33.941807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-ed0fd2af-ae9f-4bb2-8303-5624c176f064 req-b8f9c118-9693-4c46-9b78-9f8a36144f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe59a7e-b84b-40b7-a271-0e7c697dfc5a", "tag": "56ab7ae3-05d0-4a62-8d32-6e2232855f49"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:33.949984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-ed0fd2af-ae9f-4bb2-8303-5624c176f064 req-b8f9c118-9693-4c46-9b78-9f8a36144f1a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:33.950420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-ed0fd2af-ae9f-4bb2-8303-5624c176f064 req-b8f9c118-9693-4c46-9b78-9f8a36144f1a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:33.961474 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-ed0fd2af-ae9f-4bb2-8303-5624c176f064 req-b8f9c118-9693-4c46-9b78-9f8a36144f1a service nova] Creating event network-changed:56ab7ae3-05d0-4a62-8d32-6e2232855f49 for instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a on hv-cinder-84684 Jun 21 03:14:33.966459 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-ed0fd2af-ae9f-4bb2-8303-5624c176f064 req-b8f9c118-9693-4c46-9b78-9f8a36144f1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158602 Jun 21 03:14:33.967296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 306/614] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:35.985964 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-6d3aa3a6-0f55-4f48-b718-54ded25b908f req-6d37b797-cf05-45ca-b13b-c8d14bd50d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe59a7e-b84b-40b7-a271-0e7c697dfc5a", "tag": "56ab7ae3-05d0-4a62-8d32-6e2232855f49"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:35.995281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6d3aa3a6-0f55-4f48-b718-54ded25b908f req-6d37b797-cf05-45ca-b13b-c8d14bd50d78 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:35.995711 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6d3aa3a6-0f55-4f48-b718-54ded25b908f req-6d37b797-cf05-45ca-b13b-c8d14bd50d78 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:36.007595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-6d3aa3a6-0f55-4f48-b718-54ded25b908f req-6d37b797-cf05-45ca-b13b-c8d14bd50d78 service nova] Creating event network-changed:56ab7ae3-05d0-4a62-8d32-6e2232855f49 for instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a on hv-cinder-84684 Jun 21 03:14:36.013345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-6d3aa3a6-0f55-4f48-b718-54ded25b908f req-6d37b797-cf05-45ca-b13b-c8d14bd50d78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033537 Jun 21 03:14:36.014302 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 309/615] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:38.703420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:38.704467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:38.711160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:38.711631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:38.712465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:38.712902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:38.799958 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lazy-loading 'services' on Instance uuid 840c12ba-1c44-43ad-9450-eea9f7b74332 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:14:38.874966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5c83d1e2-07b0-4b2c-b28a-83c6ed35201d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-volume_attachments/a73d067e-431f-4fe8-b454-d8ed2d71d1ae" status: 202 len: 0 microversion: 2.1 time: 0.284421 Jun 21 03:14:38.875622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 307/616] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:14:38 2022] DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-volume_attachments/a73d067e-431f-4fe8-b454-d8ed2d71d1ae => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:14:39.991677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2027a86a-fcc7-46d4-b6ce-e8b44c3cbd98 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:39.998791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2027a86a-fcc7-46d4-b6ce-e8b44c3cbd98 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:39.999233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2027a86a-fcc7-46d4-b6ce-e8b44c3cbd98 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:40.022232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2027a86a-fcc7-46d4-b6ce-e8b44c3cbd98 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Going to try to stop instance {{(pid=117664) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 03:14:40.067091 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2027a86a-fcc7-46d4-b6ce-e8b44c3cbd98 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action" status: 202 len: 0 microversion: 2.1 time: 0.079439 Jun 21 03:14:40.067889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 310/617] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:14:39 2022] POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:14:40.077112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:40.077810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:40.084473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:40.084981 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:40.085766 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:40.086221 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:40.224882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:40.232778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-178a15c6-0b98-44ec-a704-bb7d023fc404 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.160401 Jun 21 03:14:40.233347 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 308/618] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:40 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:41.252748 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:41.253420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:41.261009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:41.261448 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:41.262194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:41.262621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:41.403352 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:41.415768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d3329542-fa65-4901-a246-b50ec83ab8b4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.167286 Jun 21 03:14:41.416741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 311/619] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:41 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:42.439832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:42.440748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:42.448686 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:42.449213 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:42.450117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:42.450627 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:42.590841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:42.599091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d2c423d1-7a6d-4a70-9f58-0ecc95f12c24 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.165845 Jun 21 03:14:42.599653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 309/620] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:42 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:43.618440 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:43.619139 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:43.627997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:43.628596 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:43.629536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:43.630076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:43.770440 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:43.778176 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-653cf1db-5863-483c-b7df-52b475f99547 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.164562 Jun 21 03:14:43.778776 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 312/621] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:43 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:14:44.800622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:44.801555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:44.812368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:44.813157 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:44.814720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:44.815242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:44.962121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:44.970350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-50c62306-2006-4792-be21-3791cda0ddfc tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.177111 Jun 21 03:14:44.970970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 310/622] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:44 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:45.988270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:45.988922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:45.995785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:45.996228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:45.997009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:45.997751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:46.138423 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:46.146579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-50476602-52a4-4f93-b86d-d011f2f9abbd tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.162361 Jun 21 03:14:46.147138 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 313/623] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:45 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:47.163501 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:47.164220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:47.171059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:47.171507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:47.172260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:47.172720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:47.319966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:47.330490 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cdc5e53f-8012-4eb2-b4a6-73a659822231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.170888 Jun 21 03:14:47.331047 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 311/624] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:47 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:48.347500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:48.348097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:48.355737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.356188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.357092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.357779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.437060 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:48.437553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:48.443657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.444098 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.444881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.445309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.474349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3a9afde3-80aa-4d2b-bd48-450f10688a76 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/ips" status: 200 len: 149 microversion: 2.1 time: 0.159197 Jun 21 03:14:48.475237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 314/625] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:14:48 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/ips => generated 149 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:48.485316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b313e19-ed14-44b0-bbf7-9668be9abfef"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:48.486505 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:48.492501 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.492947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.493724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.494147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.555507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:48.563553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2562a900-0c0a-48c7-960d-1a4130fcb92f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.220272 Jun 21 03:14:48.564477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 312/626] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:48 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:48.581488 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Invalid volume: volume 4b313e19-ed14-44b0-bbf7-9668be9abfef is already attached to instances: dc9a9acd-00f9-4181-b4db-70d6ad6930e7 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/os-volume_attachments HTTP/1.1 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 74 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:14:48.583233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {"volumeAttachment": {"volumeId": "4b313e19-ed14-44b0-bbf7-9668be9abfef"}} Jun 21 03:14:48.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Invalid volume: volume 4b313e19-ed14-44b0-bbf7-9668be9abfef is already attached to instances: dc9a9acd-00f9-4181-b4db-70d6ad6930e7 Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'server_id': 'a2ebc898-2fa4-4c13-b321-a788afa0bd84', 'body': {'volumeAttachment': {'volumeId': '4b313e19-ed14-44b0-bbf7-9668be9abfef'}}} Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4b313e19-ed14-44b0-bbf7-9668be9abfef is already attached to instances: dc9a9acd-00f9-4181-b4db-70d6ad6930e7 Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:48.589021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4b313e19-ed14-44b0-bbf7-9668be9abfef is already attached to instances: dc9a9acd-00f9-4181-b4db-70d6ad6930e7 Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:48.590384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4b313e19-ed14-44b0-bbf7-9668be9abfef is already attached to instances: dc9a9acd-00f9-4181-b4db-70d6ad6930e7 Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 400 to user: Invalid volume: volume 4b313e19-ed14-44b0-bbf7-9668be9abfef is already attached to instances: dc9a9acd-00f9-4181-b4db-70d6ad6930e7 {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c7291182-b1fd-423d-9a16-5b10065b2850 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103238 Jun 21 03:14:48.591933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 315/627] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:14:48 2022] POST /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:14:48.594566 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:48.595058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:48.601129 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.601573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.602323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.602748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.627413 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:14:48.707455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9f7bd3b3-0b5b-4192-9bf6-f5181c726a82 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 204 len: 0 microversion: 2.1 time: 0.116759 Jun 21 03:14:48.708582 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 313/628] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:14:48 2022] DELETE /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:14:48.716737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:48.717351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:48.723380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.723826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.724618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:48.725089 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:48.856514 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:48.864214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1ea64b82-e908-42d2-bd9f-e71482722f28 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1681 microversion: 2.1 time: 0.151635 Jun 21 03:14:48.864805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 316/629] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:48 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:49.585270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:49.586126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:49.594432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:49.594984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:49.595970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:49.596773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:49.737293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:49.745175 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9635486d-42b5-4c13-a0cc-ac139cb1ecd8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.165837 Jun 21 03:14:49.745765 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 314/630] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:49 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:49.884446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:49.885125 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:49.893651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:49.894198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:49.895125 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:49.895653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:50.033081 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:50.040741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a66550ef-79c1-4c46-b355-693fbab72fee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1681 microversion: 2.1 time: 0.161223 Jun 21 03:14:50.041279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 317/631] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:49 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:50.769434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:50.770394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:50.781440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:50.782168 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:50.783656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:50.784028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:50.926529 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:50.934325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1564209c-034c-4584-a0d9-9586318f5709 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.171376 Jun 21 03:14:50.934860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 315/632] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:50 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:51.063152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:51.064142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:51.078333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:51.079069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:51.080305 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:51.080757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:51.220562 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:51.228066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-136d6f0d-75cb-462b-9c4c-f23198d5baab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1681 microversion: 2.1 time: 0.171503 Jun 21 03:14:51.228651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 318/633] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:51 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:51.951764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:51.952437 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:51.959484 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:51.959941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:51.960729 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:51.961162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:52.245337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:52.246649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:52.255004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:52.255854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:52.257169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:52.257838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:52.299931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:52.309705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b1f87b40-52d3-4918-b289-28810923f8d9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.362034 Jun 21 03:14:52.322277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 316/634] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:51 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:52.324517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:52.332559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-815804dc-00b7-47a5-b93f-95ba765ca052 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 200 len: 1613 microversion: 2.1 time: 0.091014 Jun 21 03:14:52.334846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 319/635] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:52 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 1613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:52.340976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-61726251-9993-4498-b294-dee31ba1c59c req-13872699-23a9-4955-8049-6c72f6c332cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ebc898-2fa4-4c13-b321-a788afa0bd84", "name": "network-vif-deleted", "tag": "609de0d2-a25b-4db4-a7ec-dd2c6422bb8b"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:52.349858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-61726251-9993-4498-b294-dee31ba1c59c req-13872699-23a9-4955-8049-6c72f6c332cf service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:52.350357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-61726251-9993-4498-b294-dee31ba1c59c req-13872699-23a9-4955-8049-6c72f6c332cf service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:52.362531 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-61726251-9993-4498-b294-dee31ba1c59c req-13872699-23a9-4955-8049-6c72f6c332cf service nova] Creating event network-vif-deleted:609de0d2-a25b-4db4-a7ec-dd2c6422bb8b for instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 on hv-cinder-84684 Jun 21 03:14:52.368155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-61726251-9993-4498-b294-dee31ba1c59c req-13872699-23a9-4955-8049-6c72f6c332cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044206 Jun 21 03:14:52.369097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 317/636] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:53.327088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:53.327694 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:53.334382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:53.334829 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:53.335601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:53.336030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:53.350751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:53.351884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:53.362440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:53.365343 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:53.366363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:53.367031 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:53.389188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 HTTP/1.1 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:14:53.391195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:14:53.393021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'a2ebc898-2fa4-4c13-b321-a788afa0bd84'} Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:14:53.393774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:14:53.394941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:14:53.396982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:14:53.398060 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-03a3e5a5-63af-4e58-9bd7-668c384a27f5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 404 len: 111 microversion: 2.1 time: 0.052079 Jun 21 03:14:53.398840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 318/637] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:53 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:14:53.406867 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-37c93e94-0d58-472e-8bb5-f2b42d4cda80 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '.version_select at 0x7fe79a1df160>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:53.410154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37c93e94-0d58-472e-8bb5-f2b42d4cda80 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [98f61eec-ccae-4fde-af37-b74dd076e41a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 03:14:53.480252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:53.487979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4f6b966a-e718-403b-b0e2-f64963c7d688 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.164821 Jun 21 03:14:53.488560 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 320/638] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:53 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:54.422395 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [None req-37c93e94-0d58-472e-8bb5-f2b42d4cda80 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [98f61eec-ccae-4fde-af37-b74dd076e41a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48048. Jun 21 03:14:54.452119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-37c93e94-0d58-472e-8bb5-f2b42d4cda80 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845012247" status: 202 len: 0 microversion: 2.1 time: 1.048995 Jun 21 03:14:54.452722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 319/639] 10.222.0.16 () {58 vars in 1217 bytes} [Tue Jun 21 03:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845012247 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 03:14:54.505165 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:54.505783 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:54.512676 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:54.513126 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:54.513892 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:54.514348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:54.517065 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:54.664985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:54.672792 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-69d2136a-e625-4617-8575-e3adf42d463f tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.171412 Jun 21 03:14:54.673429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 321/640] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:54 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:55.148723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:55.149256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:55.155631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:55.156078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:55.156867 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:55.157302 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:55.238661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lazy-loading 'services' on Instance uuid dc9a9acd-00f9-4181-b4db-70d6ad6930e7 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:14:55.314500 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-80fb1c7d-4565-47ca-b14c-5020307027c3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments/4b313e19-ed14-44b0-bbf7-9668be9abfef" status: 202 len: 0 microversion: 2.1 time: 0.171552 Jun 21 03:14:55.315199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 320/641] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:14:55 2022] DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments/4b313e19-ed14-44b0-bbf7-9668be9abfef => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:14:55.323515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:55.324559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:55.331233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:55.331679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:55.332443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:55.332875 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:55.361554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-779f82e9-8a9c-427c-9ca3-170598c0770e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Jun 21 03:14:55.361980 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 322/642] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:14:55 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:55.696647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:55.697660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:55.707184 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:55.707605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:55.708368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:55.708836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:55.849417 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:55.858099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-91425e35-7f6d-4b1f-a666-30327c02c94c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1676 microversion: 2.1 time: 0.169940 Jun 21 03:14:55.858706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 321/643] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:55 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:56.377239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:56.378847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:56.390225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:56.390930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:56.392226 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:56.392799 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:56.423153 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5ca5a0e0-eab5-4789-90d2-65b1db62fa11 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052883 Jun 21 03:14:56.423752 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 323/644] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:14:56 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:14:56.884880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:56.885813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:56.897304 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:56.898056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:56.899309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:56.900021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:56.904380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:14:57.054376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:57.062318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7ff452dc-dab8-47b0-a99e-3aa191d09a91 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1653 microversion: 2.1 time: 0.184048 Jun 21 03:14:57.062886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 322/645] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:56 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1653 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:57.078993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-23a18af9-997d-4e20-884c-f7715baaeae5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:14:57.085755 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-23a18af9-997d-4e20-884c-f7715baaeae5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.086196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-23a18af9-997d-4e20-884c-f7715baaeae5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.108189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-23a18af9-997d-4e20-884c-f7715baaeae5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Going to try to start instance {{(pid=117664) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 03:14:57.157184 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-23a18af9-997d-4e20-884c-f7715baaeae5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action" status: 202 len: 0 microversion: 2.1 time: 0.081332 Jun 21 03:14:57.157944 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 324/646] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:14:57 2022] POST /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:14:57.166534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:57.167139 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:57.173202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.173783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.174692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.175125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.396173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:57.404373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6a992f8a-9a2c-4f2f-8927-b179221037f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1662 microversion: 2.1 time: 0.241691 Jun 21 03:14:57.404971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 323/647] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:57 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1662 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:57.436091 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:57.437030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:57.443803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.444243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.445040 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.445463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.474295 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-431c4c10-ad3d-42ea-9536-be49aaa77335 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043101 Jun 21 03:14:57.474846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 325/648] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:14:57 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:14:57.532834 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:57.533326 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:57.539494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.539937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.540717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.541148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.566095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:14:57.648156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-33bed5c0-42c4-4df1-80b7-c52f09da2b21 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 204 len: 0 microversion: 2.1 time: 0.118878 Jun 21 03:14:57.649468 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 324/649] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:14:57 2022] DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:14:57.658047 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:57.658760 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:57.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.665715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.666657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:57.667082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:57.799671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:57.808066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-739da9f4-07b1-48c1-9c08-d53b249e17de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1678 microversion: 2.1 time: 0.154561 Jun 21 03:14:57.808671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 326/650] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:57 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:58.349285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:58.350679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:58.358356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.358933 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.359760 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.360184 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.386331 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:14:58.423879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:58.424587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:58.432099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.432546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.433300 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.433722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.469389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5d6e6b2d-25e6-47a3-9373-34b8a87c3f89 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 204 len: 0 microversion: 2.1 time: 0.125068 Jun 21 03:14:58.470098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 325/651] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:14:58 2022] DELETE /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:14:58.479104 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:58.479801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:58.485830 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.486900 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.487705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.488136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.572039 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:58.580281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2378c342-99a0-4e62-8a9e-fabee3d518d7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1662 microversion: 2.1 time: 0.161346 Jun 21 03:14:58.581304 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 327/652] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:58 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:58.623576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:58.631468 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9be203d5-90ce-4e76-89ed-7d0f9ed37d16 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1579 microversion: 2.1 time: 0.156615 Jun 21 03:14:58.632028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 326/653] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:58 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:14:58.829908 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:58.830734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:58.840957 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.841854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.843095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:58.843790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:58.973088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:58.983098 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8b79c247-e7a5-432c-b557-93b5095ed075 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1678 microversion: 2.1 time: 0.159747 Jun 21 03:14:58.983894 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 328/654] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:58 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:59.601955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:59.602902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:59.613964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:59.614703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:59.615919 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:59.617122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:59.648932 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:14:59.649516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:14:59.656245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:59.656743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:59.657483 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:14:59.658007 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:14:59.756607 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:59.765572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-30a84343-9d45-4b7e-909f-27735fe0b3c4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1666 microversion: 2.1 time: 0.170005 Jun 21 03:14:59.766176 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 327/655] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:59 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:14:59.801755 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:14:59.817895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5b59878e-797b-49e8-9d54-2094048a7f3d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1579 microversion: 2.1 time: 0.172778 Jun 21 03:14:59.818455 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 329/656] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:59 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:00.005806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:00.006794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:00.017521 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:00.018042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:00.019419 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:00.019868 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:00.168215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:00.177558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0b8a25bf-6a54-4a55-9354-57f676b10ae9 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1678 microversion: 2.1 time: 0.178085 Jun 21 03:15:00.178086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 328/657] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:14:59 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:00.839283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:00.839897 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:00.847023 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:00.847445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:00.848220 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:00.848697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:00.983719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:00.991998 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-756b7f49-3e1a-4fdc-aa9d-a15fffac611a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1579 microversion: 2.1 time: 0.156490 Jun 21 03:15:00.992606 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 330/658] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:00 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:01.198107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:01.198676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:01.206896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:01.207969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:01.208822 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:01.209233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:01.428512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:01.437636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4f004445-70fe-4199-b238-9403edb48e93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 200 len: 1678 microversion: 2.1 time: 0.243641 Jun 21 03:15:01.438402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 329/659] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:01 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:01.665390 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-254f91ab-87f7-46a0-8310-7ac1d38b43dc req-f28808c7-1796-4d44-8fec-3be23e7b8b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc9a9acd-00f9-4181-b4db-70d6ad6930e7", "name": "network-vif-deleted", "tag": "dea46eac-9326-474c-8b29-1ce4d2d9cada"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:01.670760 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=48 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:01.676452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-254f91ab-87f7-46a0-8310-7ac1d38b43dc req-f28808c7-1796-4d44-8fec-3be23e7b8b42 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:01.677214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-254f91ab-87f7-46a0-8310-7ac1d38b43dc req-f28808c7-1796-4d44-8fec-3be23e7b8b42 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:01.690630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-254f91ab-87f7-46a0-8310-7ac1d38b43dc req-f28808c7-1796-4d44-8fec-3be23e7b8b42 service nova] Creating event network-vif-deleted:dea46eac-9326-474c-8b29-1ce4d2d9cada for instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 on hv-cinder-84684 Jun 21 03:15:01.703256 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-254f91ab-87f7-46a0-8310-7ac1d38b43dc req-f28808c7-1796-4d44-8fec-3be23e7b8b42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041625 Jun 21 03:15:01.705148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 331/660] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:02.010493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:02.011605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:02.019594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:02.020166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:02.021250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:02.021812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:02.116329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-07a43642-9a18-444c-81c7-90d2860d43b7 req-ad21b1f7-5879-458c-a8e2-e1ebdf6ad8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4150dd80-06fc-4868-a656-f2d72b1552a8", "name": "network-vif-deleted", "tag": "4eb3a576-26df-497c-a783-cc6b344c468a"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:02.127827 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-07a43642-9a18-444c-81c7-90d2860d43b7 req-ad21b1f7-5879-458c-a8e2-e1ebdf6ad8aa service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:02.128707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-07a43642-9a18-444c-81c7-90d2860d43b7 req-ad21b1f7-5879-458c-a8e2-e1ebdf6ad8aa service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:02.144972 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-07a43642-9a18-444c-81c7-90d2860d43b7 req-ad21b1f7-5879-458c-a8e2-e1ebdf6ad8aa service nova] Creating event network-vif-deleted:4eb3a576-26df-497c-a783-cc6b344c468a for instance 4150dd80-06fc-4868-a656-f2d72b1552a8 on hv-cinder-84684 Jun 21 03:15:02.156392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-07a43642-9a18-444c-81c7-90d2860d43b7 req-ad21b1f7-5879-458c-a8e2-e1ebdf6ad8aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106006 Jun 21 03:15:02.165121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:02.167075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 332/661] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:02.176221 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-89897ff8-6278-4ea9-887c-4f2a3d52fbb2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 200 len: 1511 microversion: 2.1 time: 0.170560 Jun 21 03:15:02.180459 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 330/662] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:02 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:02.455570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:02.456237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:02.463657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:02.464103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:02.464932 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:02.465356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:02.480016 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 HTTP/1.1 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:15:02.481856 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:15:02.483321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'dc9a9acd-00f9-4181-b4db-70d6ad6930e7'} Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:15:02.484732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:15:02.486015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:02.487704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:15:02.487704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c1949f20-18f4-4131-bf2e-44c77102fb93 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 404 len: 111 microversion: 2.1 time: 0.032068 Jun 21 03:15:02.494015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-70cea659-2955-4ddc-a9b2-52c728b9fe35 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '.version_select at 0x7fe79a1383a0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:02.500234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 333/663] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:02 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:15:02.503744 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:02.521722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-70cea659-2955-4ddc-a9b2-52c728b9fe35 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71903141" status: 202 len: 0 microversion: 2.1 time: 0.031737 Jun 21 03:15:02.523420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 331/664] 10.222.0.16 () {58 vars in 1214 bytes} [Tue Jun 21 03:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71903141 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:15:03.194211 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:03.196358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:03.203741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:03.203906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6a398eee-e80f-4a9d-b593-bb61be34af2b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: .version_select at 0x7fe79a1a43a0>, body: {"keypair": {"name": "tempest-keypair-435425742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+2y4THQ4KznBvSF8hcWA20gVHtYCiqyMdrmhNOu8u7ouJr8H7x4fy5XYm3KB15D+O39j0jeoq2tHojRn10tk/3kv4mxgRHzjsdKDTXzIPrsHy5Wg5TNWaoqcXV+22MxA=="}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:03.204314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:03.205354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:03.205852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:03.220152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-6a398eee-e80f-4a9d-b593-bb61be34af2b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:15:03.221286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] HTTP exception thrown: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Request method failure captured: Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 HTTP/1.1 Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTaX6ft6nZczHATaujzDWdpu01FKeiWQCPxVvdt75dOvOQYEh04J4DDR9bAPMO5iv0IuoVU6zKcxk01cDbyFcLszpkvVB8rMvglcLj39mK11KezVXK2nGzoeMdrCbDPOXTzCkp4XWvSQRVq5E36Vm2kwVBR132Iyi6bjYi4KMEn_RRM Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:15:03.222675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a43462c60384cecb441ccf14de5672e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 41c4d3bab2164767b8eefcb4427b65b7 Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:15:03.224248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '4150dd80-06fc-4868-a656-f2d72b1552a8'} Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:15:03.225095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:15:03.227346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:03.230045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Returning 404 to user: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:15:03.230045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2cba3d2d-0d4a-42c8-8140-2e33b838373d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 404 len: 111 microversion: 2.1 time: 0.034291 Jun 21 03:15:03.230045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 334/665] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:03 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:15:03.230482 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-6a398eee-e80f-4a9d-b593-bb61be34af2b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:15:03.256939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6a398eee-e80f-4a9d-b593-bb61be34af2b tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056628 Jun 21 03:15:03.257935 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 332/666] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:15:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:03.390528 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-509546830", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782746954", "security_groups": [{"name": "tempest-secgroup-smoke-1515630251"}], "block_device_mapping_v2": [{"uuid": "2a5f6f6d-c074-43cf-9bab-aff6790f8e0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65ee22e2-1b27-4fab-b33d-329c4e3c290a"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:03.543484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] validate_networks() for [('65ee22e2-1b27-4fab-b33d-329c4e3c290a', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:15:04.202669 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:15:04.203282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:15:04.203708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:15:04.204162 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:15:04.204785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:15:04.214035 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:04.214478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:04.215346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:04.215773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:04.232818 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for project 1a43462c60384cecb441ccf14de5672e. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:15:04.237131 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for user 41c4d3bab2164767b8eefcb4427b65b7 and project 1a43462c60384cecb441ccf14de5672e. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:15:04.296567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:15:04.298719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a5f6f6d-c074-43cf-9bab-aff6790f8e0f',volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:15:04.441563 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d48991cd-935f-4f29-97c9-adfd7ed05344 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.053697 Jun 21 03:15:04.442281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 335/667] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:15:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 03:15:04.453319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-88bb53cf-9497-4acd-aa54-57d16708ca83 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:04.453997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-88bb53cf-9497-4acd-aa54-57d16708ca83 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:04.510519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-88bb53cf-9497-4acd-aa54-57d16708ca83 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:04.517795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-88bb53cf-9497-4acd-aa54-57d16708ca83 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1094 microversion: 2.1 time: 0.068793 Jun 21 03:15:04.518343 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 333/668] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:04 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:04.847063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-442786511", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c23877e-0103-47a1-a2d4-5b0d47022cc2"}], "security_groups": [{"name": "tempest-securitygroup--296960965"}], "key_name": "tempest-keypair-435425742", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:04.958557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] validate_networks() for [('4c23877e-0103-47a1-a2d4-5b0d47022cc2', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:15:05.367055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:15:05.367675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:15:05.367926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:15:05.368358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:15:05.368806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:15:05.378507 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:05.378951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:05.379743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:05.380170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:05.397822 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:15:05.401823 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:15:05.413100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:15:05.415216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:15:05.463816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bd8fc928-f1ff-49fd-a8bd-8ad28b90fb37 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621181 Jun 21 03:15:05.464968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 336/669] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:15:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:15:05.475246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-29dfe335-c3c2-4fa4-b4f8-21d7aecdd34c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:05.477662 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-29dfe335-c3c2-4fa4-b4f8-21d7aecdd34c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:05.534679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-add8522b-d84f-4c40-9eab-b4286061a8da tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:05.535205 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-add8522b-d84f-4c40-9eab-b4286061a8da tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:05.539005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-29dfe335-c3c2-4fa4-b4f8-21d7aecdd34c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:05.549194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-29dfe335-c3c2-4fa4-b4f8-21d7aecdd34c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1240 microversion: 2.1 time: 0.078138 Jun 21 03:15:05.550992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 334/670] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:05 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:05.589933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-add8522b-d84f-4c40-9eab-b4286061a8da tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:05.597474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-add8522b-d84f-4c40-9eab-b4286061a8da tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1094 microversion: 2.1 time: 0.066994 Jun 21 03:15:05.598246 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 337/671] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:05 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:06.568754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:06.569364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:06.576076 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:06.576574 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:06.577362 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:06.577812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:06.626915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ebd386d7-8e02-425d-b9f8-6dee203eb484 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:06.627528 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ebd386d7-8e02-425d-b9f8-6dee203eb484 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:06.655554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:06.663256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7333a102-4648-45e8-bf3b-3fb77b6af743 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1292 microversion: 2.1 time: 0.098974 Jun 21 03:15:06.663910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 335/672] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:06 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:06.689148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ebd386d7-8e02-425d-b9f8-6dee203eb484 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:06.697185 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ebd386d7-8e02-425d-b9f8-6dee203eb484 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1094 microversion: 2.1 time: 0.076693 Jun 21 03:15:06.698134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 338/673] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:06 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:07.680386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:07.681036 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:07.687980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:07.688510 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:07.689340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:07.689797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:07.713584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4d08d0d8-8cc7-4650-8f16-f7535112b927 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:07.714803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4d08d0d8-8cc7-4650-8f16-f7535112b927 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:07.788092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4d08d0d8-8cc7-4650-8f16-f7535112b927 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:07.795010 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4d08d0d8-8cc7-4650-8f16-f7535112b927 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1094 microversion: 2.1 time: 0.085189 Jun 21 03:15:07.798833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 339/674] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:07 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:07.852790 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:07.863220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fcfb9ffc-ff1b-49c9-84bd-311581aee1c0 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.186764 Jun 21 03:15:07.873313 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 336/675] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:07 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:08.522056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-c90fdc03-de42-4626-94b0-70360d6bd1cb req-f29136be-eb75-4f21-89a6-72a117270b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a", "tag": "e72c0c57-d536-41d4-b5c1-44e92bed5223"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:08.531240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c90fdc03-de42-4626-94b0-70360d6bd1cb req-f29136be-eb75-4f21-89a6-72a117270b72 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:08.531701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c90fdc03-de42-4626-94b0-70360d6bd1cb req-f29136be-eb75-4f21-89a6-72a117270b72 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:08.549993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-c90fdc03-de42-4626-94b0-70360d6bd1cb req-f29136be-eb75-4f21-89a6-72a117270b72 service nova] Creating event network-changed:e72c0c57-d536-41d4-b5c1-44e92bed5223 for instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a on hv-cinder-84684 Jun 21 03:15:08.555267 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-c90fdc03-de42-4626-94b0-70360d6bd1cb req-f29136be-eb75-4f21-89a6-72a117270b72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043757 Jun 21 03:15:08.556107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 340/676] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:08.815988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:08.816643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:08.823604 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:08.824049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:08.824873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:08.825307 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:08.882402 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:08.883096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:08.889651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:08.890091 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:08.890848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:08.891277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:08.891421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:08.899604 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2d7251b9-19f9-4517-9be1-c341f14c41b8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1144 microversion: 2.1 time: 0.089433 Jun 21 03:15:08.902587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 337/677] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:08 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:09.098415 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:09.106400 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ddfbabab-7bd8-4a94-9b26-653c9817c0ad tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.229104 Jun 21 03:15:09.107213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 341/678] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:08 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:09.920794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:09.921675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:09.929768 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:09.930203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:09.931323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:09.931748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:10.002057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:10.010103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-04db1256-5912-4e0f-943e-b6bed0fd41f6 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1192 microversion: 2.1 time: 0.096104 Jun 21 03:15:10.010662 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 338/679] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:09 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:10.127254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:10.128107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:10.136072 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:10.136660 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:10.137536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:10.138030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:10.282238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:10.289987 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f7589ff9-7c3f-4d40-a758-35a1173e178a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.169464 Jun 21 03:15:10.290518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 342/680] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:10 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:11.031348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:11.032491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:11.040035 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.040511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.041273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.041707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.056275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:11.111761 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:11.123534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-185c8c4e-6793-4384-9561-2d7b3b5cb9ea tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1192 microversion: 2.1 time: 0.098486 Jun 21 03:15:11.124346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 339/681] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:11 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:11.261981 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:11.262590 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:11.270484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.270929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.271674 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.272105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.301716 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d237039f-436f-4c06-bc0b-141954fb392f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments/b1b0d310-4980-4cbc-8196-552e4faf7928" status: 200 len: 194 microversion: 2.20 time: 0.044385 Jun 21 03:15:11.302211 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 343/682] 10.222.0.16 () {60 vars in 1453 bytes} [Tue Jun 21 03:15:11 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments/b1b0d310-4980-4cbc-8196-552e4faf7928 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:15:11.307740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:11.308354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:11.314833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.315402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.316182 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.316654 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.367723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:11.367896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:11.374816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.375260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.376020 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.376625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.395323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:11.464722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lazy-loading 'services' on Instance uuid bade48e3-65d3-406d-8d36-53e1f560e554 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:15:11.475797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:11.483438 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f6c8650d-ffba-48c3-9323-6ebc259ba1ba tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.180058 Jun 21 03:15:11.484087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 340/683] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:11 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:11.537520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5463e4dc-ad31-4773-9b0c-a148f8f63b7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments/b1b0d310-4980-4cbc-8196-552e4faf7928" status: 202 len: 0 microversion: 2.20 time: 0.174401 Jun 21 03:15:11.538104 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 344/684] 10.222.0.16 () {60 vars in 1456 bytes} [Tue Jun 21 03:15:11 2022] DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments/b1b0d310-4980-4cbc-8196-552e4faf7928 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:15:11.546573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:11.547646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:11.554111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.554496 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.555248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:11.555678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:11.585144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-058c2ff5-8b59-463e-bcce-db14b0a68600 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042540 Jun 21 03:15:11.585676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 341/685] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jun 21 03:15:11 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:15:12.146486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:12.147200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:12.155104 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:12.155653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:12.156572 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:12.157074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:12.259006 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:12.270829 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7e2cc3f2-0621-45de-8674-6fbfbe49dc09 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1210 microversion: 2.1 time: 0.130844 Jun 21 03:15:12.272018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 345/686] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:12 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:12.501759 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:12.502611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:12.510219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:12.510907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:12.511925 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:12.512605 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:12.600135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:12.601458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:12.616225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:12.616765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:12.617566 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:12.621474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:12.678566 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e784e68-5f03-4ca8-8226-8e150145c5ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084376 Jun 21 03:15:12.679136 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 346/687] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jun 21 03:15:12 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 03:15:12.738727 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:12.747801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-44f5f25b-a364-471a-8b7a-49164ae077a6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.250098 Jun 21 03:15:12.748718 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 342/688] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:12 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:13.288881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:13.290093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:13.297214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.298219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.299404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.299531 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.436996 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:13.446119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b097d7d1-4702-45e7-878b-afe623a49a42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1278 microversion: 2.1 time: 0.161644 Jun 21 03:15:13.446840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 347/689] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:13 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:13.690383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:13.692057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:13.698715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.699439 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.700195 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.700815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.730431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-704f0ec5-17bc-44ce-9624-785e17052fb5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044098 Jun 21 03:15:13.730927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 343/690] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jun 21 03:15:13 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:13.766040 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:13.766740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:13.774936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-9735b644-d8cd-44c3-85ab-bf0139d9c2ee req-8df330a1-beb0-455e-b5a1-35793c268fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a28709-3264-4283-8e03-832e6d214e47", "tag": "39a8025d-3186-49e5-8cef-f5a4411ac88f"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:13.788706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.788706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.788706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.789434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.796289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9735b644-d8cd-44c3-85ab-bf0139d9c2ee req-8df330a1-beb0-455e-b5a1-35793c268fce service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.796658 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9735b644-d8cd-44c3-85ab-bf0139d9c2ee req-8df330a1-beb0-455e-b5a1-35793c268fce service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.808695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-9735b644-d8cd-44c3-85ab-bf0139d9c2ee req-8df330a1-beb0-455e-b5a1-35793c268fce service nova] Creating event network-changed:39a8025d-3186-49e5-8cef-f5a4411ac88f for instance 62a28709-3264-4283-8e03-832e6d214e47 on hv-cinder-84684 Jun 21 03:15:13.814141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-9735b644-d8cd-44c3-85ab-bf0139d9c2ee req-8df330a1-beb0-455e-b5a1-35793c268fce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042679 Jun 21 03:15:13.815070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 344/691] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:15:13.820287 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:13.821340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:13.828546 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.828992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.829751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.830173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.861286 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:15:13.952627 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6f366b3d-6493-45a0-b504-8020f88759e6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 204 len: 0 microversion: 2.20 time: 0.135831 Jun 21 03:15:13.953516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 345/692] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jun 21 03:15:13 2022] DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 03:15:13.966368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:13.967197 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:13.974126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.974716 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.975589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:13.976015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:13.982457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:13.990801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9689c047-f99d-4028-bb73-267c068b225c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.229055 Jun 21 03:15:13.991673 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 348/693] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:13 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:14.117256 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:14.125854 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:14.127430 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:14.128914 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-eb94050a-c779-4848-84fe-1a90c98d83a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.167050 Jun 21 03:15:14.129474 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 346/694] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:13 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:14.464046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:14.464767 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:14.471823 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:14.472309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:14.473109 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:14.473539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:14.613063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:14.620993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-34d80c5d-5e73-4d18-91f5-9c8191a60fab tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.161162 Jun 21 03:15:14.621902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 349/695] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:14 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:14.638007 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-484fa566-7386-47e2-ae77-51f0bffcfe1a req-f821a413-e55f-498f-8892-c306dd03796e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a", "name": "network-vif-plugged", "status": "completed", "tag": "e72c0c57-d536-41d4-b5c1-44e92bed5223"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:14.646455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-484fa566-7386-47e2-ae77-51f0bffcfe1a req-f821a413-e55f-498f-8892-c306dd03796e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:14.646898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-484fa566-7386-47e2-ae77-51f0bffcfe1a req-f821a413-e55f-498f-8892-c306dd03796e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:14.657816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-484fa566-7386-47e2-ae77-51f0bffcfe1a req-f821a413-e55f-498f-8892-c306dd03796e service nova] Creating event network-vif-plugged:e72c0c57-d536-41d4-b5c1-44e92bed5223 for instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a on hv-cinder-84684 Jun 21 03:15:14.662946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-484fa566-7386-47e2-ae77-51f0bffcfe1a req-f821a413-e55f-498f-8892-c306dd03796e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091115 Jun 21 03:15:14.663535 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 347/696] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:15.009583 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:15.010497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:15.018269 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:15.018810 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:15.020031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:15.020757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:15.148740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:15.149636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:15.154942 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:15.156178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:15.156667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:15.157625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:15.158897 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:15.163183 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a81081d6-21ce-4db5-9007-7c9446f9b2fb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.157755 Jun 21 03:15:15.163979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 350/697] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:15 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:15.291086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:15.303624 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:15.305924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:15.307587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ee77fa62-1a54-47b8-94c2-e415d70f54f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.163540 Jun 21 03:15:15.308368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 348/698] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:15 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:15.638731 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:15.639322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:15.642262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:15.646968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:15.647407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:15.648168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:15.648619 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:15.807932 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:15.815855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2a7178cd-bd6d-4efa-8ff1-68ad0937016c tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.180965 Jun 21 03:15:15.816434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 351/699] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:15 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:16.180788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:16.181421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:16.183532 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=8 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:16.190086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:16.190549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:16.191326 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:16.191752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:16.329223 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:16.330736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:16.330865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:16.336077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:16.336621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:16.337398 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:16.337849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:16.339283 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-10c81f5d-f559-4408-8612-4560b8c4a09a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.161865 Jun 21 03:15:16.340092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 349/700] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:16 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:16.478445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:16.489435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:16.490920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:16.492070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b1b9f2f1-7506-4420-a18d-2dc2f48b4c86 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.167410 Jun 21 03:15:16.492657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 352/701] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:16 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:16.832023 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:16.832647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:16.839194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:16.839664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:16.840452 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:16.840890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:16.988784 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:17.000618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ca972e53-a232-4028-ab9b-2975aff1b00f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.172078 Jun 21 03:15:17.001295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 350/702] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:16 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:17.361085 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:17.362117 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:17.369136 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:17.369601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:17.370398 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:17.370801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:17.503492 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:17.510661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:17.511204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-670116a0-91d9-41de-b9ad-b44356101915 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1365 microversion: 2.1 time: 0.156635 Jun 21 03:15:17.511369 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:17.511639 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 353/703] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:17 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:17.518116 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:17.518564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:17.519466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:17.519898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:17.652567 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:17.662242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:17.663728 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:17.664913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e5a4f8b2-3717-4d02-b2fa-fcd9b3b5690b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1723 microversion: 2.20 time: 0.158256 Jun 21 03:15:17.665472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 351/704] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:17 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:18.018090 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:18.018748 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:18.022094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=18 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:18.026655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.027062 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.027993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.028620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.300217 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:18.310096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff766ae0-6d2b-474c-849f-8eddb52dc532 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.295997 Jun 21 03:15:18.312664 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 354/705] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:18 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:18.527928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:18.528596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:18.535477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.535909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.536710 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.537163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.672597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:18.681385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-65acd697-6ab2-4671-9a4a-4ab9536a9da8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1554 microversion: 2.1 time: 0.157114 Jun 21 03:15:18.692519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 352/706] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:18 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:18.692727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:18.692727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:18.692727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.692727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.693375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.693375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.699100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:18.699514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:18.707029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.707480 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.708246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.708703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.793202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:18.805117 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:18.806616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:18.807786 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fce1e74e-d428-469b-8953-2b7127ba1440 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 200 len: 1656 microversion: 2.20 time: 0.128529 Jun 21 03:15:18.808341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 355/707] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:18 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 1656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:18.825732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-c7f77e8b-8002-45b1-85ab-73b55c5491dc req-8203b845-0c7c-44cf-8491-e78a2f271932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade48e3-65d3-406d-8d36-53e1f560e554", "name": "network-vif-deleted", "tag": "a6a84e7e-f693-4251-bff2-a21fced5ba19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:18.835697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c7f77e8b-8002-45b1-85ab-73b55c5491dc req-8203b845-0c7c-44cf-8491-e78a2f271932 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:18.836122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c7f77e8b-8002-45b1-85ab-73b55c5491dc req-8203b845-0c7c-44cf-8491-e78a2f271932 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:18.847348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7524a51d-cef5-4ea7-9a51-0996e76b203f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152015 Jun 21 03:15:18.848307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-c7f77e8b-8002-45b1-85ab-73b55c5491dc req-8203b845-0c7c-44cf-8491-e78a2f271932 service nova] Creating event network-vif-deleted:a6a84e7e-f693-4251-bff2-a21fced5ba19 for instance bade48e3-65d3-406d-8d36-53e1f560e554 on hv-cinder-84684 Jun 21 03:15:18.849454 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 353/708] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:15:18 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:18.854022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-c7f77e8b-8002-45b1-85ab-73b55c5491dc req-8203b845-0c7c-44cf-8491-e78a2f271932 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037821 Jun 21 03:15:18.854787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 356/709] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:19.327397 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:19.328065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:19.335106 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:19.335783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:19.336892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:19.337513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:19.666802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:19.675706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e9e62241-8910-400d-a59f-7f9a49c52204 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.352370 Jun 21 03:15:19.676377 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 354/710] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:19 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:19.827431 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:19.828159 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:19.836017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:19.836510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:19.837420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:19.837916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:19.852555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] HTTP exception thrown: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Request method failure captured: Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 HTTP/1.1 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZIhIHG2l-h10I5xE7shOYMDJ9hFzie2wgobpBBrq2X51CwfYw277DB6pNAi_uZEtlHDOmXgV46nEBXxhDpTq5HAHHUAxX5N2PPrd5xBNvVqoF17DOixNizuJ6L2wLPX30gn4JisTa5zyUrQHUirCwCFhT3MCWbIJ72laMqX05kpx0 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:15:19.854222 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5badbc0000cf41beb6fd192462d4eda8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: b778c9e1d53c44edb54b0c94c458e20c Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:15:19.855734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'bade48e3-65d3-406d-8d36-53e1f560e554'} Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:15:19.856633 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:15:19.857769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:19.858840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Returning 404 to user: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:15:19.858840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c14e5862-97dc-4541-af1a-633f0b6e6c0a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 404 len: 111 microversion: 2.20 time: 0.033047 Jun 21 03:15:19.858840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 357/711] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:19 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:15:19.865557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5ee52677-d7b9-4bf9-8db2-ce503deb11a1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '.version_select at 0x7fe79a348ca0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:19.885526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5ee52677-d7b9-4bf9-8db2-ce503deb11a1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491865930" status: 204 len: 0 microversion: 2.20 time: 0.024391 Jun 21 03:15:19.886089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 355/712] 10.222.0.16 () {60 vars in 1261 bytes} [Tue Jun 21 03:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491865930 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 03:15:20.111235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-e7f7e533-faa0-46fa-bcbd-bf2ccda538eb req-25cf43ea-edd8-41ff-b529-1134e178b05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a", "tag": "e72c0c57-d536-41d4-b5c1-44e92bed5223"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:20.119346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e7f7e533-faa0-46fa-bcbd-bf2ccda538eb req-25cf43ea-edd8-41ff-b529-1134e178b05b service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:20.119778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e7f7e533-faa0-46fa-bcbd-bf2ccda538eb req-25cf43ea-edd8-41ff-b529-1134e178b05b service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:20.131245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-e7f7e533-faa0-46fa-bcbd-bf2ccda538eb req-25cf43ea-edd8-41ff-b529-1134e178b05b service nova] Creating event network-changed:e72c0c57-d536-41d4-b5c1-44e92bed5223 for instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a on hv-cinder-84684 Jun 21 03:15:20.136262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-e7f7e533-faa0-46fa-bcbd-bf2ccda538eb req-25cf43ea-edd8-41ff-b529-1134e178b05b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028589 Jun 21 03:15:20.136880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 358/713] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:20.565809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8301ad77-c260-43e7-bdb6-81cf55a82feb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'create', calling method: .version_select at 0x7fe79a1599d0>, body: {"keypair": {"name": "tempest-keypair-2123699676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UghI8yY0dvlL/JldahHnOXhgNXvgnMccrnYqPtkA+Y9SfPdLPhwmHu08OKxDkBATXsKZkiCZPwb8EnVmqxWCtBZLG4AalabKii4tZY35NpEdsdyJjKwD482aN4FN7Vg=="}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:20.580281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-8301ad77-c260-43e7-bdb6-81cf55a82feb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:15:20.584361 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-8301ad77-c260-43e7-bdb6-81cf55a82feb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for user b778c9e1d53c44edb54b0c94c458e20c and project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:15:20.608447 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8301ad77-c260-43e7-bdb6-81cf55a82feb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046554 Jun 21 03:15:20.609051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 356/714] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Jun 21 03:15:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 03:15:20.776343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:20.777076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:20.786869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:20.787342 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:20.788043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:20.788498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:20.993094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:21.002098 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d6d808c8-d24a-4912-badd-a2fc0a38f4aa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.310087 Jun 21 03:15:21.003124 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 359/715] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:20 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:22.014103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-460948176", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcb1b71f-0c69-4277-b872-e57779bda511"}], "security_groups": [{"name": "tempest-securitygroup--754025725"}], "key_name": "tempest-keypair-2123699676", "user_data": "}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:22.019183 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:22.019791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:22.026787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:22.027254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:22.028012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:22.028442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:22.119339 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] validate_networks() for [('dcb1b71f-0c69-4277-b872-e57779bda511', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:15:22.161681 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:22.170111 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b75d9aea-815e-47d4-a90e-e857478c5d67 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.154943 Jun 21 03:15:22.170878 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 360/716] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:22 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:22.568057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:15:22.568712 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:15:22.569389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:15:22.569946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:15:22.570551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:15:22.582764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:22.583205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:22.583986 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:22.584434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:22.602230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:15:22.606759 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Getting quotas for user b778c9e1d53c44edb54b0c94c458e20c and project 5badbc0000cf41beb6fd192462d4eda8. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:15:22.619199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:15:22.621452 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:15:22.631449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:22.670028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8243d427-eb8e-4e83-9dcb-75a729d32ba2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.661059 Jun 21 03:15:22.670658 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 357/717] 10.222.0.16 () {62 vars in 1187 bytes} [Tue Jun 21 03:15:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 03:15:22.680723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab19ed28-7575-49c7-8f50-84f1fb2ea121 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:22.681331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ab19ed28-7575-49c7-8f50-84f1fb2ea121 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:22.689144 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:22.738785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ab19ed28-7575-49c7-8f50-84f1fb2ea121 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:22.746512 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ab19ed28-7575-49c7-8f50-84f1fb2ea121 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:22.748211 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ab19ed28-7575-49c7-8f50-84f1fb2ea121 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:22.749372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ab19ed28-7575-49c7-8f50-84f1fb2ea121 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1281 microversion: 2.20 time: 0.072629 Jun 21 03:15:22.749940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 361/718] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:22 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:23.188320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:23.188924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:23.195763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:23.196220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:23.197006 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:23.197433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:23.328706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:23.330975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:23.337533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fc23aa70-1e53-44f2-b2c0-def58acb6679 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.153697 Jun 21 03:15:23.338101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 358/719] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:23 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:23.771426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:23.772703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:23.783730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:23.784343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:23.785133 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:23.785596 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:23.848123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:23.860637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:23.863602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:23.865336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f936880f-b668-4d62-b327-5efab88589c4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1285 microversion: 2.20 time: 0.100282 Jun 21 03:15:23.866102 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 362/720] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:23 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:24.354179 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:24.354800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:24.362021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:24.362509 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:24.363259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:24.363689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:24.513715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:24.526647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-95509a76-0aaf-45cb-90f2-e70c3669f86d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.176605 Jun 21 03:15:24.527224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 359/721] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:24 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:24.887458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:24.888083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:24.895351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:24.895802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:24.896657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:24.897100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:24.913009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:24.964726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:24.973976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:24.975477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:24.976641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d0ded24e-d020-482d-8453-4413cbb1cb2c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1341 microversion: 2.20 time: 0.093081 Jun 21 03:15:24.977390 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 363/722] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:24 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1341 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:25.545891 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:25.546683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:25.553741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:25.554184 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:25.554940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:25.555365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:25.996309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:25.997003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:26.005692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:26.006426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:26.007182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:26.007626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:26.008836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:26.017656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e4dce124-7869-490f-92b4-deb54912afc9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.475941 Jun 21 03:15:26.018476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 360/723] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:25 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:26.166453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:26.175885 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:26.177696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:26.179002 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-92f20f25-b1c0-4e38-b6a3-cf68f0ea7591 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.187219 Jun 21 03:15:26.179593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 364/724] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:25 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:26.733276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-cc5f3921-ee42-4063-8d26-74086bf4ea70 req-6b1d1c5b-5ffb-4a3e-851b-6b275f98f849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:26.743800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-cc5f3921-ee42-4063-8d26-74086bf4ea70 req-6b1d1c5b-5ffb-4a3e-851b-6b275f98f849 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:26.745556 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-cc5f3921-ee42-4063-8d26-74086bf4ea70 req-6b1d1c5b-5ffb-4a3e-851b-6b275f98f849 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:26.759191 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-cc5f3921-ee42-4063-8d26-74086bf4ea70 req-6b1d1c5b-5ffb-4a3e-851b-6b275f98f849 service nova] Creating event network-changed:9c44fe99-d9b0-4a66-9a2b-1d4a42af9261 for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 on hv-cinder-84684 Jun 21 03:15:26.765975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-cc5f3921-ee42-4063-8d26-74086bf4ea70 req-6b1d1c5b-5ffb-4a3e-851b-6b275f98f849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037982 Jun 21 03:15:26.767299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 361/725] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:27.034886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:27.036254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:27.043621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:27.044065 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:27.044855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:27.045284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:27.189918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:27.198402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:27.198603 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1355d4ef-bcb2-460f-8806-fe871444dde1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.167526 Jun 21 03:15:27.199477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:27.199968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 365/726] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:27 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:27.207291 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:27.207987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:27.208957 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:27.209805 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:27.346130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:27.354485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:27.355991 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:27.357173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1eb37ab8-afcd-40f9-969c-e4971c0b5149 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.163873 Jun 21 03:15:27.358048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 362/727] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:27 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:27.734212 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:15:27.734580 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:15:28.217291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:28.217935 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:28.225683 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:28.226121 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:28.226872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:28.227292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:28.373270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:28.374867 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:28.375468 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:28.381749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-26ee87b8-6614-4830-9590-7f0f344be3a7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.168962 Jun 21 03:15:28.381997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:28.382342 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 366/728] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:28 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:28.382498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:28.383138 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:28.383737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:28.523626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:28.531964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:28.533532 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:28.534639 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-83ada4ca-a9b2-43e8-8159-92da6962fb44 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.163956 Jun 21 03:15:28.535205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 363/729] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:28 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:15:28.677458 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-39591e0f-f606-455a-8478-b1e2e97ba3dc req-a671c956-8189-41ae-a141-b454a9a3a950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a28709-3264-4283-8e03-832e6d214e47", "name": "network-vif-plugged", "status": "completed", "tag": "39a8025d-3186-49e5-8cef-f5a4411ac88f"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:28.685831 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-39591e0f-f606-455a-8478-b1e2e97ba3dc req-a671c956-8189-41ae-a141-b454a9a3a950 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:28.686195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-39591e0f-f606-455a-8478-b1e2e97ba3dc req-a671c956-8189-41ae-a141-b454a9a3a950 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:28.700268 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-39591e0f-f606-455a-8478-b1e2e97ba3dc req-a671c956-8189-41ae-a141-b454a9a3a950 service nova] Creating event network-vif-plugged:39a8025d-3186-49e5-8cef-f5a4411ac88f for instance 62a28709-3264-4283-8e03-832e6d214e47 on hv-cinder-84684 Jun 21 03:15:28.706819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-39591e0f-f606-455a-8478-b1e2e97ba3dc req-a671c956-8189-41ae-a141-b454a9a3a950 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031513 Jun 21 03:15:28.706819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 367/730] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:29.403591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:29.404732 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:29.416203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:29.416998 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:29.418253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:29.418965 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:29.553887 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:29.554571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:29.560474 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:29.562995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:29.563548 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:29.564650 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:29.565074 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:29.569234 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7e2b2ccd-b4ac-4b04-998c-dcc3a59d2795 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.173421 Jun 21 03:15:29.569835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 364/731] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:29 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:29.705478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:29.717961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:29.720103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:29.721372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1bbff526-4eb9-47ae-aac9-91336651b5ca tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.172584 Jun 21 03:15:29.721923 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 368/732] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:29 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:30.585487 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:30.586222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:30.595938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:30.596463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:30.597232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:30.597667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:30.739207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:30.740708 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:30.747803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:30.748325 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:30.749178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:30.749726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:30.758087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:30.769600 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c31af1ac-b2ce-4283-99a7-62d9bdc4f62f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.187963 Jun 21 03:15:30.776259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 365/733] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:30 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:30.898333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:30.909840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:30.912090 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:30.913793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-22607160-ff5c-4dcc-a7be-16af6030b5e2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.178371 Jun 21 03:15:30.914518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 369/734] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:30 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:15:31.786111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:31.786731 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:31.793678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:31.794129 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:31.794888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:31.795316 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:31.932063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:31.932672 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:31.939000 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:31.939568 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:31.940324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:31.940786 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:31.943198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:31.950680 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1eb58784-55e9-46a1-8779-38d68e063dbe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1266 microversion: 2.1 time: 0.168957 Jun 21 03:15:31.951328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 366/735] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:31 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:32.075208 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:32.087465 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:32.089829 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:32.091472 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b99a053b-7a0f-465c-be35-d48369b485a9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.163120 Jun 21 03:15:32.092238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 370/736] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:31 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:32.784377 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-b05168d5-6ca3-4b00-b6a0-e37c5ecf66a3 req-4931d194-d8f7-4681-8361-e960437714fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "name": "network-vif-plugged", "status": "completed", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:32.789476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:32.792198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=10 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:32.795108 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-b05168d5-6ca3-4b00-b6a0-e37c5ecf66a3 req-4931d194-d8f7-4681-8361-e960437714fa service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:32.795536 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-b05168d5-6ca3-4b00-b6a0-e37c5ecf66a3 req-4931d194-d8f7-4681-8361-e960437714fa service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:32.807729 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-b05168d5-6ca3-4b00-b6a0-e37c5ecf66a3 req-4931d194-d8f7-4681-8361-e960437714fa service nova] Creating event network-vif-plugged:9c44fe99-d9b0-4a66-9a2b-1d4a42af9261 for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 on hv-cinder-84684 Jun 21 03:15:32.812955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-b05168d5-6ca3-4b00-b6a0-e37c5ecf66a3 req-4931d194-d8f7-4681-8361-e960437714fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Jun 21 03:15:32.813598 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 367/737] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:32.969529 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:32.970443 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:32.972515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:32.979367 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:32.979780 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:32.981135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:32.981715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:33.110289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:33.110987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:33.117956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:33.118482 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:33.119813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:33.120262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:33.129172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:33.137062 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eccb714f-a95a-4b21-a6d6-d4eca2c6d8f3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1452 microversion: 2.1 time: 0.172743 Jun 21 03:15:33.137751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 371/738] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:32 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:33.155729 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:33.156329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:33.163065 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:33.163508 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:33.164278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:33.164715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:33.263805 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:33.275580 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:33.277847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:33.279467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7eadd127-3933-4286-aac1-77fefade3a93 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.173720 Jun 21 03:15:33.280472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 368/739] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:33 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:33.326729 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:33.334486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-af4b4a24-fa5e-470f-82b8-7ad954aad14b tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1452 microversion: 2.1 time: 0.183590 Jun 21 03:15:33.335057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 372/740] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:33 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:34.298802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:34.299611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:34.306334 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:34.306776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:34.307522 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:34.307953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:34.515173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:34.523715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:34.525296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:34.526404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7d259d08-a97b-4abb-b088-a0ad521e852d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1406 microversion: 2.20 time: 0.231594 Jun 21 03:15:34.526975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 369/741] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:34 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:35.048368 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-b5a53f7a-cb99-4c22-aca5-d3bc08b2dfa6 req-32967e2b-f9f1-41f7-98c4-f8e11ed39022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a28709-3264-4283-8e03-832e6d214e47", "tag": "39a8025d-3186-49e5-8cef-f5a4411ac88f"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:35.057775 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b5a53f7a-cb99-4c22-aca5-d3bc08b2dfa6 req-32967e2b-f9f1-41f7-98c4-f8e11ed39022 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:35.058220 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b5a53f7a-cb99-4c22-aca5-d3bc08b2dfa6 req-32967e2b-f9f1-41f7-98c4-f8e11ed39022 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:35.069879 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-b5a53f7a-cb99-4c22-aca5-d3bc08b2dfa6 req-32967e2b-f9f1-41f7-98c4-f8e11ed39022 service nova] Creating event network-changed:39a8025d-3186-49e5-8cef-f5a4411ac88f for instance 62a28709-3264-4283-8e03-832e6d214e47 on hv-cinder-84684 Jun 21 03:15:35.074693 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-b5a53f7a-cb99-4c22-aca5-d3bc08b2dfa6 req-32967e2b-f9f1-41f7-98c4-f8e11ed39022 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030070 Jun 21 03:15:35.075472 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 373/742] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:35.544787 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:35.546190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:35.553890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:35.554347 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:35.555330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:35.555777 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:35.751359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:35.759865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:35.761321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:35.762495 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-84324bcc-ce26-4cf4-b634-f958efa4a9f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1598 microversion: 2.20 time: 0.221799 Jun 21 03:15:35.763057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 370/743] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:15:35 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1598 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:15:35.780936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:35.781510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:35.788233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:35.788802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:35.789564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:35.789990 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:35.883701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9dcba56d-564a-417d-b079-87548c24b8a7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107078 Jun 21 03:15:35.884401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 374/744] 10.222.0.16 () {60 vars in 1315 bytes} [Tue Jun 21 03:15:35 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:15:37.097401 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-5074d484-74b5-45cc-9d09-5355d3ddb696 req-f5c13a02-46f6-4204-ac38-83d435b09a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:37.106167 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-5074d484-74b5-45cc-9d09-5355d3ddb696 req-f5c13a02-46f6-4204-ac38-83d435b09a00 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:37.106606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-5074d484-74b5-45cc-9d09-5355d3ddb696 req-f5c13a02-46f6-4204-ac38-83d435b09a00 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:37.118564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-5074d484-74b5-45cc-9d09-5355d3ddb696 req-f5c13a02-46f6-4204-ac38-83d435b09a00 service nova] Creating event network-changed:9c44fe99-d9b0-4a66-9a2b-1d4a42af9261 for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 on hv-cinder-84684 Jun 21 03:15:37.124205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-5074d484-74b5-45cc-9d09-5355d3ddb696 req-f5c13a02-46f6-4204-ac38-83d435b09a00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031357 Jun 21 03:15:37.124983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 371/745] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:40.472978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:40.473809 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:40.483349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:40.484140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:40.485099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:40.485752 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:40.573022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lazy-loading 'services' on Instance uuid efe59a7e-b84b-40b7-a271-0e7c697dfc5a {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:15:40.665559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d462353a-28ed-4aaa-82b0-935ba64f3012 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments/23ace432-c0b9-4799-99d8-c14d2e545ee9" status: 202 len: 0 microversion: 2.1 time: 0.199431 Jun 21 03:15:40.666427 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 375/746] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:15:40 2022] DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments/23ace432-c0b9-4799-99d8-c14d2e545ee9 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:15:40.678464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:40.679539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:40.687639 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:40.688193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:40.690088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:40.690548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:40.722978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3fd49304-101b-4d99-b1a3-730a5b091eee tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050295 Jun 21 03:15:40.723539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 372/747] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:15:40 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:41.736276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:41.737396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:41.745272 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:41.745743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:41.746497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:41.746926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:41.777801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a7e675cb-a2ca-4a2d-af39-1212276a7a17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Jun 21 03:15:41.778920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 376/748] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:15:41 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:42.795286 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:42.796827 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:42.805156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:42.805609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:42.806375 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:42.806816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:42.837100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-90e99f5b-659f-40b7-9340-3f789526dba6 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048578 Jun 21 03:15:42.837657 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 373/749] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:15:42 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:15:42.919320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:42.919888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:42.926762 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:42.927203 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:42.927955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:42.928383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:42.953778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:15:43.037022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-69faf283-635e-44af-b3c4-e9f53f4bc6f0 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 204 len: 0 microversion: 2.1 time: 0.121196 Jun 21 03:15:43.037803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 377/750] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:15:42 2022] DELETE /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:15:43.046276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:43.046810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:43.053323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:43.053770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:43.054533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:43.054972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:43.186003 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:43.194384 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2967e7f8-2c0b-47fe-9e73-96c572c07916 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1692 microversion: 2.1 time: 0.152190 Jun 21 03:15:43.194956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 374/751] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:43 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:15:44.212614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:44.213306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:44.220145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:44.220672 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:44.221433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:44.221891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:44.353574 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:44.361601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-00dc8d6e-dd30-4bf7-b998-5827351b09f9 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1692 microversion: 2.1 time: 0.153369 Jun 21 03:15:44.362328 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 378/752] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:44 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:45.383853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:45.384881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:45.395556 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:45.396320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:45.397587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:45.398309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:45.535186 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:45.546350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-07395462-5bfc-46b1-af1b-0d1ca6c12ed8 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1692 microversion: 2.1 time: 0.168929 Jun 21 03:15:45.547226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 375/753] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:45 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:46.567867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:46.568819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:46.579763 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:46.580228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:46.581023 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:46.581445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:46.596218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:46.729776 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:46.737894 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-85e6c63a-efdb-4262-8f84-296d673bee17 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1692 microversion: 2.1 time: 0.176416 Jun 21 03:15:46.738462 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 379/754] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:46 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:47.756610 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:47.757226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:47.763420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-ca644a38-c619-42fe-b4ec-a058a71a3c1b req-b8737081-e8b1-405b-82a4-943f785b9fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe59a7e-b84b-40b7-a271-0e7c697dfc5a", "name": "network-vif-deleted", "tag": "56ab7ae3-05d0-4a62-8d32-6e2232855f49"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:47.764870 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:47.765319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:47.766080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:47.766694 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:47.776765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ca644a38-c619-42fe-b4ec-a058a71a3c1b req-b8737081-e8b1-405b-82a4-943f785b9fae service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:47.779076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ca644a38-c619-42fe-b4ec-a058a71a3c1b req-b8737081-e8b1-405b-82a4-943f785b9fae service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:47.792163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-ca644a38-c619-42fe-b4ec-a058a71a3c1b req-b8737081-e8b1-405b-82a4-943f785b9fae service nova] Creating event network-vif-deleted:56ab7ae3-05d0-4a62-8d32-6e2232855f49 for instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a on hv-cinder-84684 Jun 21 03:15:47.797415 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-ca644a38-c619-42fe-b4ec-a058a71a3c1b req-b8737081-e8b1-405b-82a4-943f785b9fae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040422 Jun 21 03:15:47.798598 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 380/755] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:47.844758 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:47.853777 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-583b64fe-d269-4850-898d-5d892db8586b tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 200 len: 1624 microversion: 2.1 time: 0.102250 Jun 21 03:15:47.854597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 376/756] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:47 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 1624 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:48.872158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:48.873224 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: efe59a7e-b84b-40b7-a271-0e7c697dfc5a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:48.879594 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:48.880033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:48.880821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:48.881246 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:48.894657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] HTTP exception thrown: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a could not be found. Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Request method failure captured: Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a HTTP/1.1 Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZFsE57y111iJ6jScviONiJarz-kohNHNtmD6ZXTo-M9n7SkKUTRGok56P_1k6ps01sUdEqJbv1q355v3rAkFUJhCjf3wx3dONdKixDnhRQ-WupcbXee0O9GhSs-vulJ5vSQERSuGotTDKLgjXri_qgHMkrPo2uz1gwUN5foj0u5pQ Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:15:48.896282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262f17284a44afaa2b5d2d2db0a3ef6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 8bd2fc9f3216425cbcbbed84b7815529 Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a could not be found. Jun 21 03:15:48.897906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'efe59a7e-b84b-40b7-a271-0e7c697dfc5a'} Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a could not be found. Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:15:48.898739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a could not be found. Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a could not be found. Jun 21 03:15:48.899995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:48.901143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Returning 404 to user: Instance efe59a7e-b84b-40b7-a271-0e7c697dfc5a could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:15:48.901143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-79da168e-fe9f-49c6-9437-362b6b715d43 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a" status: 404 len: 111 microversion: 2.1 time: 0.030264 Jun 21 03:15:48.901143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 381/757] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:48 2022] GET /compute/v2.1/servers/efe59a7e-b84b-40b7-a271-0e7c697dfc5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:15:48.906847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f12c1a53-f2a8-44b2-89de-3ae15e7347b4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '.version_select at 0x7fe79a168310>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:48.926096 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f12c1a53-f2a8-44b2-89de-3ae15e7347b4 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212661621" status: 202 len: 0 microversion: 2.1 time: 0.023055 Jun 21 03:15:48.926654 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 377/758] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jun 21 03:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212661621 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:15:51.846559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:51.846559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:51.853405 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:51.853853 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:51.854619 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:51.855050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:51.882987 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:15:51.969547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c16b221e-20bf-46d8-8137-753c0f622ebe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 204 len: 0 microversion: 2.1 time: 0.127298 Jun 21 03:15:51.970263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 382/759] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:15:51 2022] DELETE /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:15:51.978968 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:51.979572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:51.986299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:51.986741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:51.987491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:51.987919 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:52.002745 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:52.125058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:52.133241 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-18665130-c679-4a51-8d66-81d8ee424810 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1504 microversion: 2.1 time: 0.158608 Jun 21 03:15:52.133779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 378/760] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:51 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:53.153586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:53.154251 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:53.156852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:53.162210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:53.162656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:53.163452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:53.163846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:53.300122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:53.309474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-128d87a4-b5c3-4dae-8363-b8a954a92320 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 200 len: 1504 microversion: 2.1 time: 0.162652 Jun 21 03:15:53.310044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 383/761] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:53 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:53.394214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-5c1f2c2a-24ab-4271-b1b1-47969ab3ad2f req-fae4e4ed-61db-492f-80d0-061885493629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416a380b-f69e-4101-8c88-d26221caf707", "name": "network-vif-deleted", "tag": "7dcab122-3477-4e02-b7aa-acd704037607"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:53.399611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:15:53.406314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-5c1f2c2a-24ab-4271-b1b1-47969ab3ad2f req-fae4e4ed-61db-492f-80d0-061885493629 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:53.406748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-5c1f2c2a-24ab-4271-b1b1-47969ab3ad2f req-fae4e4ed-61db-492f-80d0-061885493629 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:53.421896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-5c1f2c2a-24ab-4271-b1b1-47969ab3ad2f req-fae4e4ed-61db-492f-80d0-061885493629 service nova] Creating event network-vif-deleted:7dcab122-3477-4e02-b7aa-acd704037607 for instance 416a380b-f69e-4101-8c88-d26221caf707 on hv-cinder-84684 Jun 21 03:15:53.428065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-5c1f2c2a-24ab-4271-b1b1-47969ab3ad2f req-fae4e4ed-61db-492f-80d0-061885493629 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038267 Jun 21 03:15:53.429109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 379/762] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:15:54.327439 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:54.328086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: 416a380b-f69e-4101-8c88-d26221caf707] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:54.335275 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:54.335716 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:54.336498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:54.336923 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:54.350544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] HTTP exception thrown: Instance 416a380b-f69e-4101-8c88-d26221caf707 could not be found. Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Request method failure captured: Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 HTTP/1.1 Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZFsE57y111iJ6jScviONiJarz-kohNHNtmD6ZXTo-M9n7SkKUTRGok56P_1k6ps01sUdEqJbv1q355v3rAkFUJhCjf3wx3dONdKixDnhRQ-WupcbXee0O9GhSs-vulJ5vSQERSuGotTDKLgjXri_qgHMkrPo2uz1gwUN5foj0u5pQ Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:15:54.352214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262f17284a44afaa2b5d2d2db0a3ef6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 8bd2fc9f3216425cbcbbed84b7815529 Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 416a380b-f69e-4101-8c88-d26221caf707 could not be found. Jun 21 03:15:54.353687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '416a380b-f69e-4101-8c88-d26221caf707'} Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416a380b-f69e-4101-8c88-d26221caf707 could not be found. Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:15:54.354404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416a380b-f69e-4101-8c88-d26221caf707 could not be found. Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416a380b-f69e-4101-8c88-d26221caf707 could not be found. Jun 21 03:15:54.355546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:15:54.356613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Returning 404 to user: Instance 416a380b-f69e-4101-8c88-d26221caf707 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:15:54.356613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2c4d4246-4b5f-4bb0-be4f-93acce6d2983 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707" status: 404 len: 111 microversion: 2.1 time: 0.030205 Jun 21 03:15:54.356613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 384/763] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:54 2022] GET /compute/v2.1/servers/416a380b-f69e-4101-8c88-d26221caf707 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:15:54.365670 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:54.366221 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:54.376027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:54.376613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:54.377364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:54.377793 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:54.403031 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:15:54.494110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7842ca6a-eec6-4286-8cb3-68155748ef5f tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 204 len: 0 microversion: 2.1 time: 0.135201 Jun 21 03:15:54.494669 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 380/764] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:15:54 2022] DELETE /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:15:54.503776 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:54.504454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:54.510742 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:54.511178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:54.511921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:54.512348 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:54.656802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:54.669022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eb838fe7-3d15-4718-aeba-19ab0ebab047 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.169142 Jun 21 03:15:54.669811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 385/765] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:54 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:55.693985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:55.695169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:55.705666 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:55.706142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:55.706866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:55.707293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:55.865419 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:55.873320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-39752a47-c9f2-46de-8d67-0ec4ba677f8c tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.186993 Jun 21 03:15:55.873877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 381/766] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:55 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:56.891322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:56.892455 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:56.898899 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:56.899359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:56.900082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:56.900544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:57.054936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:57.066946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1e7cdaf8-58c9-4959-891e-75a1a9e7b4fe tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1522 microversion: 2.1 time: 0.179223 Jun 21 03:15:57.067816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 386/767] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:56 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:57.717232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-3b62265f-5403-40d0-94e0-f1e7b5c97fd1 req-71abda3b-283b-40e1-9943-4e7cb7d11d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa1873d-908f-4d20-b5f3-5c6c74ea0294", "name": "network-vif-deleted", "tag": "b35ccf44-ec65-4aac-bc20-97be5d1a8d07"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:15:57.725775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-3b62265f-5403-40d0-94e0-f1e7b5c97fd1 req-71abda3b-283b-40e1-9943-4e7cb7d11d32 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:57.726251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-3b62265f-5403-40d0-94e0-f1e7b5c97fd1 req-71abda3b-283b-40e1-9943-4e7cb7d11d32 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:57.737623 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-3b62265f-5403-40d0-94e0-f1e7b5c97fd1 req-71abda3b-283b-40e1-9943-4e7cb7d11d32 service nova] Creating event network-vif-deleted:b35ccf44-ec65-4aac-bc20-97be5d1a8d07 for instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 on hv-cinder-84684 Jun 21 03:15:57.742481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-3b62265f-5403-40d0-94e0-f1e7b5c97fd1 req-71abda3b-283b-40e1-9943-4e7cb7d11d32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029320 Jun 21 03:15:57.743087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 382/768] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:15:58.085029 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:58.085647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:58.092376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:58.092881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:58.093656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:58.094092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:58.128497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:58.128946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:58.129398 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lazy-loading 'fault' on Instance uuid aaa1873d-908f-4d20-b5f3-5c6c74ea0294 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:15:58.170861 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd2fc9f3216425cbcbbed84b7815529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262f17284a44afaa2b5d2d2db0a3ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:15:58.178841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-aff3fd3e-f23d-4485-b4bd-d79a728c3aae tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 200 len: 1311 microversion: 2.1 time: 0.097716 Jun 21 03:15:58.179423 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 387/769] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:58 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:15:59.198058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:15:59.198747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] [instance: aaa1873d-908f-4d20-b5f3-5c6c74ea0294] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:15:59.205862 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:59.206336 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:59.207087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:15:59.207512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:15:59.221768 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] HTTP exception thrown: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 could not be found. Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Request method failure captured: Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 HTTP/1.1 Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZFsE57y111iJ6jScviONiJarz-kohNHNtmD6ZXTo-M9n7SkKUTRGok56P_1k6ps01sUdEqJbv1q355v3rAkFUJhCjf3wx3dONdKixDnhRQ-WupcbXee0O9GhSs-vulJ5vSQERSuGotTDKLgjXri_qgHMkrPo2uz1gwUN5foj0u5pQ Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:15:59.223391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262f17284a44afaa2b5d2d2db0a3ef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262f17284a44afaa2b5d2d2db0a3ef6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 7262f17284a44afaa2b5d2d2db0a3ef6 Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-712845406 Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 8bd2fc9f3216425cbcbbed84b7815529 Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-712845406-project Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 could not be found. Jun 21 03:15:59.224875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'aaa1873d-908f-4d20-b5f3-5c6c74ea0294'} Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 could not be found. Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:15:59.225616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 could not be found. Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 could not be found. Jun 21 03:15:59.226806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:15:59.227906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] Returning 404 to user: Instance aaa1873d-908f-4d20-b5f3-5c6c74ea0294 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:15:59.227906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dd7dc8a9-c0b0-49af-875a-7010b8d58ce2 tempest-ServerRescueNegativeTestJSON-712845406 tempest-ServerRescueNegativeTestJSON-712845406-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294" status: 404 len: 111 microversion: 2.1 time: 0.031537 Jun 21 03:15:59.227906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 383/770] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:15:59 2022] GET /compute/v2.1/servers/aaa1873d-908f-4d20-b5f3-5c6c74ea0294 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:16:03.243865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:03.245105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:03.254001 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:03.254475 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:03.255245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:03.255872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:03.286181 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6494d260-29c1-4369-8767-8728f2a10c0d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046215 Jun 21 03:16:03.286771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 388/771] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:16:03 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:16:03.343170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:03.343664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:03.352467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:03.352920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:03.353855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:03.354402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:03.381214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:16:03.458653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-768da5c6-ae2b-4cc2-8127-f5830a0cbc17 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 204 len: 0 microversion: 2.1 time: 0.119022 Jun 21 03:16:03.459301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 384/772] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:16:03 2022] DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:16:03.467539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:03.468214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:03.474481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:03.474922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:03.475670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:03.476088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:03.607258 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:03.615097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-860a1d72-8819-45ed-959f-ca25ef8788e4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1672 microversion: 2.1 time: 0.151224 Jun 21 03:16:03.615583 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 389/773] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:03 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:04.633278 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:04.633961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:04.640613 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:04.641062 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:04.641855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:04.642396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:04.778855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:04.786714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-97c26a54-d81e-4800-9de2-d8132d6017b5 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1672 microversion: 2.1 time: 0.157645 Jun 21 03:16:04.787288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 385/774] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:04 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:05.803261 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:05.803870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:05.811003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:05.811470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:05.812206 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:05.812649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:05.896243 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:05.906911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-02501886-0869-4faf-86b8-e4705b3b26e2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 200 len: 1604 microversion: 2.1 time: 0.107390 Jun 21 03:16:05.908080 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 390/775] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:05 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:05.937734 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-a75a231e-9c5d-4817-94f4-6ab53ad1e764 req-6f62fd09-dfc6-4b6e-b912-bcb914bfa5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840c12ba-1c44-43ad-9450-eea9f7b74332", "name": "network-vif-deleted", "tag": "2f44f583-f139-4fef-81d7-43b8032d3a1a"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:05.946606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-a75a231e-9c5d-4817-94f4-6ab53ad1e764 req-6f62fd09-dfc6-4b6e-b912-bcb914bfa5c3 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:05.946987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-a75a231e-9c5d-4817-94f4-6ab53ad1e764 req-6f62fd09-dfc6-4b6e-b912-bcb914bfa5c3 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:05.958610 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-a75a231e-9c5d-4817-94f4-6ab53ad1e764 req-6f62fd09-dfc6-4b6e-b912-bcb914bfa5c3 service nova] Creating event network-vif-deleted:2f44f583-f139-4fef-81d7-43b8032d3a1a for instance 840c12ba-1c44-43ad-9450-eea9f7b74332 on hv-cinder-84684 Jun 21 03:16:05.963497 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-a75a231e-9c5d-4817-94f4-6ab53ad1e764 req-6f62fd09-dfc6-4b6e-b912-bcb914bfa5c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029637 Jun 21 03:16:05.964582 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 386/776] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:06.924849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:06.925591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:06.933044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:06.933591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:06.935025 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:06.935463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:06.949943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] HTTP exception thrown: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Request method failure captured: Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 HTTP/1.1 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZDbxcN1_F3qYWREviYIM1XC4bk0x3IINWFak0S-caL_ewK543tGZYQPHW62_avpzGe5EgiWPDNSCYBIGjUVAl-GSL2fB7YNCTxxkpwSADSd7W3UVe35XXOGmJ9FO3VytzezKQhO0SvmYq5O-_N4a-BPReRLOnzJHvuu5AnpZAaCv4 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:16:06.951496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd05fc495454e9290c277ed4db003d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 937fff3ec09e4f8a9a9a5fcdf2027a2b Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:16:06.953120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '840c12ba-1c44-43ad-9450-eea9f7b74332'} Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:16:06.953982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:16:06.955555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:16:06.956896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Returning 404 to user: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:16:06.956896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-522867a8-b726-47e8-bd8a-ae0428f1baf3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 404 len: 111 microversion: 2.1 time: 0.032366 Jun 21 03:16:06.956896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 391/777] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:06 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:16:06.963432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8998e87c-801b-4d45-85a6-b8e31f1d6d8d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '.version_select at 0x7fe79a12af70>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:06.984809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8998e87c-801b-4d45-85a6-b8e31f1d6d8d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614271192" status: 202 len: 0 microversion: 2.1 time: 0.026062 Jun 21 03:16:06.988661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 387/778] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jun 21 03:16:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614271192 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:16:07.639094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d9f101b-b916-4668-baab-fd8488039638 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: .version_select at 0x7fe79a0b0c10>, body: {"keypair": {"name": "tempest-keypair-1227046273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3WxAe/FSFghs7ulrP1jFfhluMktqy6K/OUao6o4BISs8NUtwx+s9D22lXx8WsxFtiraW0XlIC6QhbLlOfxVWAEXw4QMDwHXn2NNKcnw2cR1/2/cjb/Ov835NUZMfkiOQ=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:07.653066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-5d9f101b-b916-4668-baab-fd8488039638 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for project 8dd05fc495454e9290c277ed4db003d8. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:16:07.656893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-5d9f101b-b916-4668-baab-fd8488039638 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for user 937fff3ec09e4f8a9a9a5fcdf2027a2b and project 8dd05fc495454e9290c277ed4db003d8. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:16:07.684607 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d9f101b-b916-4668-baab-fd8488039638 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049409 Jun 21 03:16:07.685236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 392/779] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:16:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:09.013078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1406918531", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bfb184d-dbe2-40fa-876c-bcaf1f55ee1e"}], "security_groups": [{"name": "tempest-securitygroup--1939545795"}], "key_name": "tempest-keypair-1227046273", "user_data": "}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:09.116821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] validate_networks() for [('4bfb184d-dbe2-40fa-876c-bcaf1f55ee1e', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:16:09.719901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:16:09.720499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:16:09.721228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:16:09.721823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:16:09.722447 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:16:09.736353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:09.736837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:09.737629 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:09.738061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:09.755277 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for project 8dd05fc495454e9290c277ed4db003d8. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:16:09.759739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Getting quotas for user 937fff3ec09e4f8a9a9a5fcdf2027a2b and project 8dd05fc495454e9290c277ed4db003d8. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:16:09.772058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:16:09.774449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:16:09.824133 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6cc3cf23-4b03-4cb1-a250-d3942cc4036e tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.815823 Jun 21 03:16:09.824796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 388/780] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:16:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:16:09.835730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2987d9d7-b833-4115-9dc1-a3a74058d1c1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:09.836331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2987d9d7-b833-4115-9dc1-a3a74058d1c1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:09.890677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2987d9d7-b833-4115-9dc1-a3a74058d1c1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:09.902732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2987d9d7-b833-4115-9dc1-a3a74058d1c1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1238 microversion: 2.1 time: 0.071276 Jun 21 03:16:09.903617 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 393/781] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:09 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:10.919660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:10.920252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:10.927879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:10.928321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:10.929120 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:10.929546 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:10.990729 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:10.999048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c8966f69-df50-4758-9b37-ef0da730c95c tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1242 microversion: 2.1 time: 0.083776 Jun 21 03:16:10.999594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 389/782] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:10 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:12.015098 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:12.015728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:12.022877 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:12.023315 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:12.024066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:12.024521 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:12.088983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:12.096493 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bae0cb76-1f69-4fe1-b10d-001e82b453fe tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1242 microversion: 2.1 time: 0.085205 Jun 21 03:16:12.097061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 394/783] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:12 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:13.116938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:13.117969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:13.129358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:13.129797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:13.130552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:13.130974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:13.197835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:13.206596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d967c54b-8ef6-4230-b440-0c0aac218e83 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1242 microversion: 2.1 time: 0.096368 Jun 21 03:16:13.207234 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 390/784] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:13 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:14.224970 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:14.225831 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:14.234724 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:14.236093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:14.238562 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:14.239908 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:14.315176 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:14.322889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fd3b3b0e-6347-4b5e-9553-251c302d18c7 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1296 microversion: 2.1 time: 0.103026 Jun 21 03:16:14.323467 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 395/785] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:14 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:15.339480 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:15.340120 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:15.346863 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:15.347307 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:15.348061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:15.348525 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:15.561061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:15.567707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-071266c1-e645-4ced-b486-5a095d45df86 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.231859 Jun 21 03:16:15.568471 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 391/786] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:15 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:15.692509 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-ed036834-c172-4b25-b9c5-c698325a19f9 req-9dcc8895-ef04-4f2a-a662-2e62be39cb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c98312-5f01-40dc-8fb2-c211c3288a21", "tag": "9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:15.703085 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ed036834-c172-4b25-b9c5-c698325a19f9 req-9dcc8895-ef04-4f2a-a662-2e62be39cb68 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:15.703705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ed036834-c172-4b25-b9c5-c698325a19f9 req-9dcc8895-ef04-4f2a-a662-2e62be39cb68 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:15.716641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-ed036834-c172-4b25-b9c5-c698325a19f9 req-9dcc8895-ef04-4f2a-a662-2e62be39cb68 service nova] Creating event network-changed:9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d for instance 29c98312-5f01-40dc-8fb2-c211c3288a21 on hv-cinder-84684 Jun 21 03:16:15.721635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-ed036834-c172-4b25-b9c5-c698325a19f9 req-9dcc8895-ef04-4f2a-a662-2e62be39cb68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032941 Jun 21 03:16:15.722325 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 396/787] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:16.588731 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:16.590007 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:16.601320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:16.602053 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:16.603302 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:16.604023 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:16.741272 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:16.749874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2a381048-45eb-47dc-ad92-ea8550ceb204 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.167651 Jun 21 03:16:16.750549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 392/788] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:16 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:17.770413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:17.771768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:17.778276 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:17.778725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:17.779512 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:17.780248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:17.783362 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:17.946892 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:17.954869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0ba67030-9537-4e6a-a050-eef373e7b5c8 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.189650 Jun 21 03:16:17.955454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 397/789] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:17 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:18.971554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:18.972160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:18.978725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:18.979165 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:18.979934 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:18.980403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:19.110849 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:19.118394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-14692078-98d0-4289-b773-a069937cd012 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.150721 Jun 21 03:16:19.118918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 393/790] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:18 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:20.136863 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:20.137470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:20.139787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:20.145715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:20.146162 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:20.146931 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:20.147368 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:20.279395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:20.287070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6dea418c-48f1-4de0-b58d-b5a34c240ce3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.154068 Jun 21 03:16:20.287655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 398/791] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:20 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:21.304659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:21.305275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:21.307303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:21.308058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:21.314425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:21.314868 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:21.315628 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:21.316064 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:21.455518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:21.463655 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b2465b5f-be5b-4d08-b624-880e18d5dc97 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.162954 Jun 21 03:16:21.464228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 394/792] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:21 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:22.480687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:22.481478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:22.489747 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:22.490602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:22.491965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:22.492854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:22.627726 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:22.635159 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c509d00c-a867-4202-a23b-b78a1421ed0a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.158378 Jun 21 03:16:22.635758 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 399/793] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:22 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:23.059790 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-0ad456f1-0a7a-4972-a93c-056344e7bb96 req-0cc14b61-a234-4080-ae2e-694dc06371d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c98312-5f01-40dc-8fb2-c211c3288a21", "name": "network-vif-plugged", "status": "completed", "tag": "9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:23.070497 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-0ad456f1-0a7a-4972-a93c-056344e7bb96 req-0cc14b61-a234-4080-ae2e-694dc06371d9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:23.070969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-0ad456f1-0a7a-4972-a93c-056344e7bb96 req-0cc14b61-a234-4080-ae2e-694dc06371d9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:23.075340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:23.083634 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-0ad456f1-0a7a-4972-a93c-056344e7bb96 req-0cc14b61-a234-4080-ae2e-694dc06371d9 service nova] Creating event network-vif-plugged:9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d for instance 29c98312-5f01-40dc-8fb2-c211c3288a21 on hv-cinder-84684 Jun 21 03:16:23.089346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-0ad456f1-0a7a-4972-a93c-056344e7bb96 req-0cc14b61-a234-4080-ae2e-694dc06371d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 Jun 21 03:16:23.090202 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 395/794] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:16:23.653337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:23.653944 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:23.656263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:23.662511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:23.662961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:23.663720 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:23.664154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:23.799855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:23.807354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-71165618-022c-4cb0-a317-bf1b0676b652 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.158018 Jun 21 03:16:23.808076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 400/795] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:23 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:24.826010 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:24.826690 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:24.829113 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:24.835409 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:24.835923 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:24.836702 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:24.837141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:24.969297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:24.977239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dfd47966-50c6-44be-bc48-d09e6acaabc9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1364 microversion: 2.1 time: 0.156231 Jun 21 03:16:24.977808 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 396/796] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:24 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:25.998733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:25.999897 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:26.007313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:26.007842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:26.008642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:26.009071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:26.142303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:26.150218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8c71f14b-3c5b-4598-8c86-5991e264c323 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1548 microversion: 2.1 time: 0.158146 Jun 21 03:16:26.150824 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 401/797] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:25 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:26.167399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:26.167890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:26.175373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:26.175822 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:26.176637 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:26.177061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:26.260041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-74a7faa4-69f0-4ad0-b451-c4c2ae33efc2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096382 Jun 21 03:16:26.260941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 397/798] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:16:26 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:27.234409 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-a10437e7-30e3-4b2c-b447-9620d3601c86 req-34263e2f-59a7-42c2-9128-dbba7a512e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c98312-5f01-40dc-8fb2-c211c3288a21", "tag": "9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:27.242850 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-a10437e7-30e3-4b2c-b447-9620d3601c86 req-34263e2f-59a7-42c2-9128-dbba7a512e63 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:27.243286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-a10437e7-30e3-4b2c-b447-9620d3601c86 req-34263e2f-59a7-42c2-9128-dbba7a512e63 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:27.254461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-a10437e7-30e3-4b2c-b447-9620d3601c86 req-34263e2f-59a7-42c2-9128-dbba7a512e63 service nova] Creating event network-changed:9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d for instance 29c98312-5f01-40dc-8fb2-c211c3288a21 on hv-cinder-84684 Jun 21 03:16:27.259958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-a10437e7-30e3-4b2c-b447-9620d3601c86 req-34263e2f-59a7-42c2-9128-dbba7a512e63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029268 Jun 21 03:16:27.260626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 402/799] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:42.699323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:42.700064 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=11 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:42.704925 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1470626288", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "networks": [{"uuid": "faeef802-6aaf-4513-97dc-d31ac00c1e1f"}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:42.761889 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] validate_networks() for [('faeef802-6aaf-4513-97dc-d31ac00c1e1f', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:16:43.125794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:16:43.126282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:16:43.126754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:16:43.127151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:16:43.127550 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:16:43.139265 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:43.139639 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:43.140442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:43.140874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:43.159453 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Getting quotas for project 40661b95bfb54299a52d803f7997d8f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:16:43.163893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Getting quotas for user 04c3c140de9d4f208e371999ae70f11e and project 40661b95bfb54299a52d803f7997d8f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:16:43.175929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:16:43.178240 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:16:43.224446 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e8f1c6b5-e7fe-483c-a1c4-030593292136 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527134 Jun 21 03:16:43.225103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 398/800] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:16:43.233173 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=5 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:43.234008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=31 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:43.238385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4e9531a9-e2ee-4de4-86d8-388d1e4245d6 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:43.239106 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4e9531a9-e2ee-4de4-86d8-388d1e4245d6 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:43.293847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4e9531a9-e2ee-4de4-86d8-388d1e4245d6 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:43.300607 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4e9531a9-e2ee-4de4-86d8-388d1e4245d6 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1214 microversion: 2.1 time: 0.069103 Jun 21 03:16:43.301172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 403/801] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:43 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:44.318145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:44.318864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:44.325273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:44.325795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:44.326776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:44.327412 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:44.419996 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:44.428604 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-40f74a83-e7cf-4f5e-b9e5-020b41d66c92 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1274 microversion: 2.1 time: 0.114771 Jun 21 03:16:44.429097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 399/802] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:44 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:45.446617 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:45.447210 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:45.454893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:45.455364 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:45.456128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:45.456596 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:45.587190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:45.595082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e2812a27-475b-45f2-8ad4-965fb555f47f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.152403 Jun 21 03:16:45.595730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 404/803] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:45 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:45.714473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-9c6290fb-15e8-4338-a2ef-bf6571d05622 req-6003148e-4e83-440c-8b20-f3cfa55af1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3fe474-b7a0-4e92-9d38-3698c0c97026", "tag": "29c41984-b823-4ccd-984d-63f2521639b2"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:45.724466 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9c6290fb-15e8-4338-a2ef-bf6571d05622 req-6003148e-4e83-440c-8b20-f3cfa55af1cc service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:45.725050 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-9c6290fb-15e8-4338-a2ef-bf6571d05622 req-6003148e-4e83-440c-8b20-f3cfa55af1cc service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:45.738518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-9c6290fb-15e8-4338-a2ef-bf6571d05622 req-6003148e-4e83-440c-8b20-f3cfa55af1cc service nova] Creating event network-changed:29c41984-b823-4ccd-984d-63f2521639b2 for instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 on hv-cinder-84684 Jun 21 03:16:45.743663 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-9c6290fb-15e8-4338-a2ef-bf6571d05622 req-6003148e-4e83-440c-8b20-f3cfa55af1cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033419 Jun 21 03:16:45.744370 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 400/804] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:46.613850 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:46.614542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:46.622833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:46.623352 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:46.624228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:46.624769 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:46.760733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:46.772471 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a4abe983-7615-4cad-aeab-a64c683e22d5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.163415 Jun 21 03:16:46.773316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 405/805] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:46 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:47.798722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:47.799917 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:47.810402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:47.811191 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:47.812387 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:47.813152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:47.961278 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:47.972588 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2eb043b8-2a0e-4acf-8720-b6b49481cec7 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.181322 Jun 21 03:16:47.973311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 401/806] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:47 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:48.990595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:48.991301 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:48.998127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:48.998576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:48.999341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:48.999759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:49.135784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:49.143545 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4ca31b0b-bbdb-4d55-a913-b422cc3dbb43 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.157427 Jun 21 03:16:49.144115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 406/807] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:48 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:49.980120 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:49.981087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:49.989265 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:49.989860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:49.991068 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:49.991763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:50.019686 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ed54af7a-bbea-437d-a0a9-990b309302ee tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/ips" status: 200 len: 148 microversion: 2.1 time: 0.044502 Jun 21 03:16:50.020312 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 402/808] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:16:49 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:50.161475 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:50.162734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:50.169882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:50.170331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:50.171115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:50.171512 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:50.318768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:50.326718 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-961253c1-8259-4010-b77e-0a8415b58186 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.169899 Jun 21 03:16:50.327283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 407/809] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:50 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:51.343282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:51.343956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:51.351704 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:51.352147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:51.352933 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:51.353357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:51.359345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91c8cf86-79c1-40d6-a519-430baed98aa9"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:51.360421 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:51.367213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:51.367739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:51.368608 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:51.369108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:51.491672 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:51.499478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-30424640-fa56-4e63-8d11-879786453e04 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.160036 Jun 21 03:16:51.499985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 403/810] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:51 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:51.980570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ec101282-263d-425a-9693-23633472cfdb tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624941 Jun 21 03:16:51.981172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 408/811] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:16:51 2022] POST /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:16:52.519711 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:52.520297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:52.527212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:52.527658 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:52.528427 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:52.528874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:52.666436 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:52.674443 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0c161fac-a366-4e36-b25f-5a760c9b227b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.160566 Jun 21 03:16:52.675086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 404/812] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:52 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:53.177972 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-6ac7270e-8e08-4958-9826-c96a77179093 req-c9588a0b-4508-4f62-b84d-52d59208df26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3fe474-b7a0-4e92-9d38-3698c0c97026", "name": "network-vif-plugged", "status": "completed", "tag": "29c41984-b823-4ccd-984d-63f2521639b2"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:53.187163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6ac7270e-8e08-4958-9826-c96a77179093 req-c9588a0b-4508-4f62-b84d-52d59208df26 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:53.187605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6ac7270e-8e08-4958-9826-c96a77179093 req-c9588a0b-4508-4f62-b84d-52d59208df26 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:53.198698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-6ac7270e-8e08-4958-9826-c96a77179093 req-c9588a0b-4508-4f62-b84d-52d59208df26 service nova] Creating event network-vif-plugged:29c41984-b823-4ccd-984d-63f2521639b2 for instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 on hv-cinder-84684 Jun 21 03:16:53.203393 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-6ac7270e-8e08-4958-9826-c96a77179093 req-c9588a0b-4508-4f62-b84d-52d59208df26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030080 Jun 21 03:16:53.204059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 409/813] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:16:53.691248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:53.692482 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:53.699208 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:53.700192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:53.711609 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:53.712363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:53.713668 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:53.714363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:53.854125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:53.864319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f8570fac-0df9-49f8-9ea0-84df0a12b2d2 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.174857 Jun 21 03:16:53.864908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 405/814] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:53 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:54.881785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:16:54.889461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:54.890599 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:54.898417 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:54.898865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:54.899616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:54.900051 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:55.032803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:55.046656 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e8e98d10-9499-4bfa-94f0-d82db3bb1c21 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1314 microversion: 2.1 time: 0.166792 Jun 21 03:16:55.047239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 410/815] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:54 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:56.063305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:56.063926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:56.071117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:56.071584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:56.072333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:56.072806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:56.209455 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:56.221665 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-138c5946-0b7a-4521-90d2-ee6ed85ff299 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1496 microversion: 2.1 time: 0.162000 Jun 21 03:16:56.222485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 406/816] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:56 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:56.759668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:56.760198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:56.767314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:56.767797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:56.768838 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:56.769266 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:56.794972 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:16:56.881584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5c03fc96-48de-460a-9453-ab7d4e4b060e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 204 len: 0 microversion: 2.1 time: 0.125535 Jun 21 03:16:56.882214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 411/817] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:16:56 2022] DELETE /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:16:56.892304 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:56.893058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:56.899126 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:56.899573 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:56.900310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:56.900764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:57.038890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:57.046929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-96e36edc-7390-4281-b79f-1eee31565144 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1502 microversion: 2.1 time: 0.159927 Jun 21 03:16:57.047487 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 407/818] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:56 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:58.069129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:58.069835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:58.076965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:58.077418 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:58.078168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:58.078592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:58.219069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:58.227309 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6b3b5357-49c9-40d0-a741-2f9a2416ab7b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1502 microversion: 2.1 time: 0.164413 Jun 21 03:16:58.227888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 412/819] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:58 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:59.248045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:16:59.249245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:16:59.260260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:59.261063 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:59.262358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:59.263084 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:59.398372 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:16:59.408883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1dc9bca4-1a86-4445-b590-6ff87d5b6383 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1502 microversion: 2.1 time: 0.167314 Jun 21 03:16:59.409551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 408/820] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:16:59 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:16:59.861516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-40952707-d125-4d66-96bf-8bfe38f727d9 req-8b321a24-7a46-4304-815a-1602c99f1e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3fe474-b7a0-4e92-9d38-3698c0c97026", "name": "network-vif-deleted", "tag": "29c41984-b823-4ccd-984d-63f2521639b2"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:16:59.870840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-40952707-d125-4d66-96bf-8bfe38f727d9 req-8b321a24-7a46-4304-815a-1602c99f1e5d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:16:59.871281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-40952707-d125-4d66-96bf-8bfe38f727d9 req-8b321a24-7a46-4304-815a-1602c99f1e5d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:16:59.882744 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-40952707-d125-4d66-96bf-8bfe38f727d9 req-8b321a24-7a46-4304-815a-1602c99f1e5d service nova] Creating event network-vif-deleted:29c41984-b823-4ccd-984d-63f2521639b2 for instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 on hv-cinder-84684 Jun 21 03:16:59.887459 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-40952707-d125-4d66-96bf-8bfe38f727d9 req-8b321a24-7a46-4304-815a-1602c99f1e5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029870 Jun 21 03:16:59.888172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 413/821] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:00.430296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:00.431267 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:00.441293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.441720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.442482 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.442905 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.474333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.474793 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.475301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lazy-loading 'fault' on Instance uuid 9c3fe474-b7a0-4e92-9d38-3698c0c97026 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:17:00.521831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:00.529518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-acbed440-6bb4-4042-b4a6-661fc63c6ea3 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 200 len: 1304 microversion: 2.1 time: 0.105591 Jun 21 03:17:00.530067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 409/822] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:00 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:00.577886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91c8cf86-79c1-40d6-a519-430baed98aa9"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:00.579048 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:00.585366 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.585800 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.586539 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.586961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.666244 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Invalid volume: volume 91c8cf86-79c1-40d6-a519-430baed98aa9 is already attached to instances: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments HTTP/1.1 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 74 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:17:00.667955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {"volumeAttachment": {"volumeId": "91c8cf86-79c1-40d6-a519-430baed98aa9"}} Jun 21 03:17:00.669627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Invalid volume: volume 91c8cf86-79c1-40d6-a519-430baed98aa9 is already attached to instances: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'server_id': 'bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a', 'body': {'volumeAttachment': {'volumeId': '91c8cf86-79c1-40d6-a519-430baed98aa9'}}} Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 91c8cf86-79c1-40d6-a519-430baed98aa9 is already attached to instances: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:00.670613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 91c8cf86-79c1-40d6-a519-430baed98aa9 is already attached to instances: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:00.672066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 91c8cf86-79c1-40d6-a519-430baed98aa9 is already attached to instances: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 400 to user: Invalid volume: volume 91c8cf86-79c1-40d6-a519-430baed98aa9 is already attached to instances: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-37781217-6bf8-4761-aa78-cd00af06e81a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095936 Jun 21 03:17:00.673518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 414/823] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:17:00 2022] POST /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:17:00.735671 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:00.736325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:00.742523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.742978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.743736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.744153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.827794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lazy-loading 'services' on Instance uuid bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:17:00.926249 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a6659fdd-341a-4432-bb3f-9e78d523a0ed tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments/91c8cf86-79c1-40d6-a519-430baed98aa9" status: 202 len: 0 microversion: 2.1 time: 0.194391 Jun 21 03:17:00.926884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 410/824] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:17:00 2022] DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments/91c8cf86-79c1-40d6-a519-430baed98aa9 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:17:00.936140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:00.937113 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:00.945555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.946107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.946867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:00.947335 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:00.981955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fac5d6a6-c0e1-476e-a870-fc9a126c3cb5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Jun 21 03:17:00.982523 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 415/825] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:17:00 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:17:01.551963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:01.552683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9c3fe474-b7a0-4e92-9d38-3698c0c97026] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:01.559289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:01.559731 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:01.560545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:01.560980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:01.575297 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] HTTP exception thrown: Instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 could not be found. Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Request method failure captured: Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 HTTP/1.1 Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTgZhpJkb5EHC5dZDeCcr0qc56PH_LQUj_8vX6uBtY8F4Aht-Vj4IG5IQVmOGrf51d7vF5h120KqrJjh3qa29N7Krw2SYUUJpGvM7WXZYNULf2sdyhXrm0NGLLvvkj4q9JwncXGaE36uX-NgOcIslKKUfU6OmLlw_KVQ0XZxmZSsZoQ Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 40661b95bfb54299a52d803f7997d8f1 Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesActionsTest-2037603910 Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:17:01.576966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40661b95bfb54299a52d803f7997d8f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40661b95bfb54299a52d803f7997d8f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40661b95bfb54299a52d803f7997d8f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40661b95bfb54299a52d803f7997d8f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesActionsTest-2037603910 Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 40661b95bfb54299a52d803f7997d8f1 Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesActionsTest-2037603910 Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesActionsTest-2037603910-project Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 04c3c140de9d4f208e371999ae70f11e Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesActionsTest-2037603910-project Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 could not be found. Jun 21 03:17:01.578523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '9c3fe474-b7a0-4e92-9d38-3698c0c97026'} Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 could not be found. Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:17:01.579429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 could not be found. Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 could not be found. Jun 21 03:17:01.581055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:17:01.582399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Returning 404 to user: Instance 9c3fe474-b7a0-4e92-9d38-3698c0c97026 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:17:01.582399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0bf00729-c984-4958-b1c9-6055905d1e36 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026" status: 404 len: 111 microversion: 2.1 time: 0.033726 Jun 21 03:17:01.582399 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 411/826] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:01 2022] GET /compute/v2.1/servers/9c3fe474-b7a0-4e92-9d38-3698c0c97026 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:17:01.627652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1211214660", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "networks": [{"uuid": "faeef802-6aaf-4513-97dc-d31ac00c1e1f"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:01.682022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] validate_networks() for [('faeef802-6aaf-4513-97dc-d31ac00c1e1f', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:17:01.993897 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:01.994820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:02.001538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.001972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.003003 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.003418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.031885 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fa410199-d3e0-4000-a02a-734c8e211607 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042001 Jun 21 03:17:02.032681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 412/827] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:17:01 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 03:17:02.047478 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:17:02.047995 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:17:02.048358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:17:02.048813 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:17:02.049429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:17:02.059853 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.060242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.061078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.061514 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.078551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Getting quotas for project 40661b95bfb54299a52d803f7997d8f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:17:02.082677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Getting quotas for user 04c3c140de9d4f208e371999ae70f11e and project 40661b95bfb54299a52d803f7997d8f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:17:02.091729 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:02.092863 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:02.094092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:17:02.096540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:17:02.099464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.099870 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.100654 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.101079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.126345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:17:02.142307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fb9b6863-c0e0-45e9-8fae-cbd98fae0a4e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518997 Jun 21 03:17:02.143201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 416/828] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:17:02.156779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e81ab910-cbfe-4277-834b-938c301b6823 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:02.157606 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e81ab910-cbfe-4277-834b-938c301b6823 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:02.212430 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4bd502d2-ff2c-46cc-9780-c87b3322a2de tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 204 len: 0 microversion: 2.1 time: 0.125008 Jun 21 03:17:02.213127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 413/829] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:17:02 2022] DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:17:02.222538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:02.223284 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:02.229907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.230356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.231123 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:02.231587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:02.235862 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:02.244742 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e81ab910-cbfe-4277-834b-938c301b6823 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:02.258735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e81ab910-cbfe-4277-834b-938c301b6823 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1214 microversion: 2.1 time: 0.106254 Jun 21 03:17:02.259311 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 417/830] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:02 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:02.369969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:02.378507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2e7b0303-7969-4c94-8f02-9b660c509f8a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1678 microversion: 2.1 time: 0.160621 Jun 21 03:17:02.379089 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 414/831] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:02 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:17:03.276263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:03.276913 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:03.284579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:03.285022 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:03.285777 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:03.286204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:03.357071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:03.364727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-502fd26b-96f6-4f81-880b-5f828f8de863 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1218 microversion: 2.1 time: 0.092381 Jun 21 03:17:03.365283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 418/832] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:03 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:03.395746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:03.396350 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:03.403390 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:03.403831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:03.404615 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:03.405040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:03.542897 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:03.552539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6ed0f226-07a7-4db1-bca6-416d49c5f6c6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1678 microversion: 2.1 time: 0.160564 Jun 21 03:17:03.553095 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 415/833] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:03 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:04.390602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:04.391546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:04.399384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:04.399846 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:04.400625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:04.401053 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:04.462509 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:04.470431 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-574b4e85-d76e-4979-8133-6fb726f231dc tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1266 microversion: 2.1 time: 0.086367 Jun 21 03:17:04.470994 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 419/834] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:04 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:04.569417 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:04.570028 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:04.577022 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:04.577467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:04.578223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:04.578649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:04.812948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:04.821359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4de6c4ad-e8a4-4b7a-8c39-471049650f31 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1678 microversion: 2.1 time: 0.255771 Jun 21 03:17:04.822199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 416/835] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:04 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:05.487144 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:05.488375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:05.496549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:05.496970 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:05.498252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:05.498900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:05.520179 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:05.719941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:05.736859 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-cd8bcfca-0884-4012-bf8c-5bec91c2fc8a req-adf8ff1f-353a-413d-b926-2257f8bef42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a", "name": "network-vif-deleted", "tag": "e72c0c57-d536-41d4-b5c1-44e92bed5223"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:05.751534 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-58db2ba8-15f6-4fec-a9c1-20076cd74365 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.267178 Jun 21 03:17:05.763186 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-cd8bcfca-0884-4012-bf8c-5bec91c2fc8a req-adf8ff1f-353a-413d-b926-2257f8bef42d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:05.764360 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-cd8bcfca-0884-4012-bf8c-5bec91c2fc8a req-adf8ff1f-353a-413d-b926-2257f8bef42d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:05.768343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 420/836] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:05 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:05.784186 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-cd8bcfca-0884-4012-bf8c-5bec91c2fc8a req-adf8ff1f-353a-413d-b926-2257f8bef42d service nova] Creating event network-vif-deleted:e72c0c57-d536-41d4-b5c1-44e92bed5223 for instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a on hv-cinder-84684 Jun 21 03:17:05.790303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-cd8bcfca-0884-4012-bf8c-5bec91c2fc8a req-adf8ff1f-353a-413d-b926-2257f8bef42d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058402 Jun 21 03:17:05.791245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 417/837] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:05.838722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:05.839730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:05.847081 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:05.848194 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:05.849292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:05.850013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:05.949782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:05.958191 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-08add225-c956-4b85-a7aa-311176071d48 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 200 len: 1325 microversion: 2.1 time: 0.123197 Jun 21 03:17:05.958938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 421/838] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:05 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 1325 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:06.410519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-b50dcde8-29d5-4695-9f67-5dead2c8fde1 req-db1f1577-6005-41a0-af20-94645b156bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8c2025-ecd4-4f37-96fc-902636d13d87", "tag": "1f0d73a5-9166-4b5c-b46f-00e4c3ba58e4"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:06.429299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-b50dcde8-29d5-4695-9f67-5dead2c8fde1 req-db1f1577-6005-41a0-af20-94645b156bdc service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.431209 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-b50dcde8-29d5-4695-9f67-5dead2c8fde1 req-db1f1577-6005-41a0-af20-94645b156bdc service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.443456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-b50dcde8-29d5-4695-9f67-5dead2c8fde1 req-db1f1577-6005-41a0-af20-94645b156bdc service nova] Creating event network-changed:1f0d73a5-9166-4b5c-b46f-00e4c3ba58e4 for instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 on hv-cinder-84684 Jun 21 03:17:06.449896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-b50dcde8-29d5-4695-9f67-5dead2c8fde1 req-db1f1577-6005-41a0-af20-94645b156bdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045810 Jun 21 03:17:06.450677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 418/839] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:17:06.523732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:06.524915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:06.531919 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.532552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.533403 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.533891 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.560277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-13b2a09e-a5c8-4503-87e4-df312c85e94b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/ips" status: 200 len: 152 microversion: 2.20 time: 0.040488 Jun 21 03:17:06.561066 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 422/840] 10.222.0.16 () {60 vars in 1288 bytes} [Tue Jun 21 03:17:06 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:17:06.769507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:06.770210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:06.777709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.778150 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.778929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.779519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.967409 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:06.975533 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:06.976138 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:06.981752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-578fb194-0bea-42ac-ab44-c6fa05b1108d tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.216715 Jun 21 03:17:06.982123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.982493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 419/841] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:06 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:06.982618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.983359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:06.983789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:06.997186 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a HTTP/1.1 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:17:06.999017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:17:07.000682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a'} Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:17:07.001578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:17:07.003623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:07.004986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:17:07.005216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-83469faf-52a0-48f9-895a-9bab455bcfa5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 404 len: 111 microversion: 2.1 time: 0.033854 Jun 21 03:17:07.005929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 423/842] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:06 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:17:07.014451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d1b5c354-7c4f-44a5-b7fc-6b71ca708e84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '.version_select at 0x7fe79a3489d0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:07.032985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d1b5c354-7c4f-44a5-b7fc-6b71ca708e84 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435425742" status: 202 len: 0 microversion: 2.1 time: 0.022387 Jun 21 03:17:07.033540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 420/843] 10.222.0.16 () {58 vars in 1217 bytes} [Tue Jun 21 03:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435425742 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:17:07.691097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-90d412f4-adbd-4589-b2d8-0ddaf34ef7e3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: .version_select at 0x7fe79a049a60>, body: {"keypair": {"name": "tempest-keypair-1756545987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntL+5VSJnUkVqtF5A63ciw5iKFgQYc6vltCvW+Hf2vs769ct5e52dR8o/NrfzSi/DrA3znmc1B+N8r+heWDVoGywxBv45Gu3BxaDpu/AYlcd+P12S8myKCA+NxiDHu9g=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:07.706256 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-90d412f4-adbd-4589-b2d8-0ddaf34ef7e3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:17:07.710623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-90d412f4-adbd-4589-b2d8-0ddaf34ef7e3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:17:07.737067 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-90d412f4-adbd-4589-b2d8-0ddaf34ef7e3 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050268 Jun 21 03:17:07.737714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 424/844] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:17:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:08.000457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:08.001529 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:08.009239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:08.009689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:08.010459 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:08.010892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:08.166438 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:08.174312 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fb38a778-d9ab-49e6-9909-3e59782e0efe tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.179458 Jun 21 03:17:08.175003 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 421/845] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:07 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:08.439667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:08.440272 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:08.447615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:08.448055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:08.448839 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:08.449264 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:08.471515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lazy-loading 'flavor' on Instance uuid 4bc90d8e-e522-4996-93ac-0bde3b2c1549 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:17:08.730822 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c94e41d4-021b-4c8f-accb-b5a818bc07db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/action" status: 202 len: 0 microversion: 2.20 time: 0.294942 Jun 21 03:17:08.731520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 425/846] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jun 21 03:17:08 2022] POST /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:17:08.739890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:08.740519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:08.746705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:08.747151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:08.748222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:08.748681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:08.879207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:08.887552 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:08.889105 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:08.890659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dbf21124-1e3b-4b28-81bf-18b1992b0e4b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.154949 Jun 21 03:17:08.891235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 422/847] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:08 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:17:09.065510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-960658694", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c23877e-0103-47a1-a2d4-5b0d47022cc2"}], "security_groups": [{"name": "tempest-securitygroup--1423505406"}], "key_name": "tempest-keypair-1756545987", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:09.169756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] validate_networks() for [('4c23877e-0103-47a1-a2d4-5b0d47022cc2', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:17:09.191587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:09.192199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:09.199260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:09.199706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:09.200523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:09.200954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:09.337408 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:09.344905 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-60710474-8b9c-4de8-8370-64fd87a56fad tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.157501 Jun 21 03:17:09.345469 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 423/848] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:09 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:09.591868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:17:09.592291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:17:09.592802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:17:09.593237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:17:09.593645 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:17:09.603911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:09.604356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:09.605225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:09.605631 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:09.623161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:17:09.628078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Getting quotas for user 5bb9100dcf2a4522840d726d800fe013 and project febf273149c744e08e0f7ea65e44e0d9. Resources: {'cores', 'ram', 'instances'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:17:09.640236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:17:09.642643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:17:09.690798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1feda73f-cc1d-4c76-930d-70bc84d24933 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629514 Jun 21 03:17:09.691626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 426/849] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:17:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:17:09.701309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-176af94f-cb43-42fc-9824-69c9c80b72c1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:09.701924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-176af94f-cb43-42fc-9824-69c9c80b72c1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:09.774288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-176af94f-cb43-42fc-9824-69c9c80b72c1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:09.781416 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-176af94f-cb43-42fc-9824-69c9c80b72c1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1241 microversion: 2.1 time: 0.083889 Jun 21 03:17:09.782266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 424/850] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:09 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:09.911497 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:09.912106 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:09.915296 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:09.919719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:09.920453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:09.921213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:09.921806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:10.124685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:10.133918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:10.135417 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:10.136655 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7561160b-f3d9-484a-af58-7b61783e4ba9 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.231319 Jun 21 03:17:10.137457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 427/851] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:09 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:17:10.364115 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:10.364749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:10.371874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:10.372253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:10.373355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:10.373778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:10.505888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:10.516824 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1d2f9b8c-64fe-4110-a68e-b88eff7f956f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.157687 Jun 21 03:17:10.517583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 425/852] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:10 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:10.799151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:10.800186 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:10.807091 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:10.807541 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:10.808280 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:10.808734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:10.878201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:10.886372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4d5c6656-7dcd-41e5-a05b-1a3c3a16d8cd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1311 microversion: 2.1 time: 0.091116 Jun 21 03:17:10.886937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 428/853] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:10 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:11.157005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:11.158031 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:11.164569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:11.165145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:11.166221 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:11.166720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:11.318188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:11.327156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:11.328691 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:11.330110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7f18681f-ad70-4cdd-aab5-28b609341da7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.177575 Jun 21 03:17:11.330821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 426/854] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:11 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:11.535727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:11.536340 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:11.543151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:11.543598 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:11.544658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:11.544791 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:11.754554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:11.762129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6c6ac843-5562-49df-8715-d3fe722646d8 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.231591 Jun 21 03:17:11.762683 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 429/855] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:11 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:11.903311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:11.903979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:11.911625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:11.912097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:11.913088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:11.913583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:12.058913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:12.067269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fcd7a464-bb04-4b9e-ad95-201410329ea8 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.167753 Jun 21 03:17:12.067855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 427/856] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:11 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:12.349179 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:12.350043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:12.357549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:12.358105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:12.359211 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:12.359756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:12.552341 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-50a07358-a1bb-45bc-ae15-2ee4d05c4bb6 req-aea17928-d8f4-48d7-ab91-ea7dfd202e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3491b64-77fe-4354-9999-2313c72376c6", "tag": "12563adb-7248-488a-a2fe-6a26eb6579a4"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:12.561521 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-50a07358-a1bb-45bc-ae15-2ee4d05c4bb6 req-aea17928-d8f4-48d7-ab91-ea7dfd202e50 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:12.561968 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-50a07358-a1bb-45bc-ae15-2ee4d05c4bb6 req-aea17928-d8f4-48d7-ab91-ea7dfd202e50 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:12.584848 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-50a07358-a1bb-45bc-ae15-2ee4d05c4bb6 req-aea17928-d8f4-48d7-ab91-ea7dfd202e50 service nova] Creating event network-changed:12563adb-7248-488a-a2fe-6a26eb6579a4 for instance a3491b64-77fe-4354-9999-2313c72376c6 on hv-cinder-84684 Jun 21 03:17:12.594194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-50a07358-a1bb-45bc-ae15-2ee4d05c4bb6 req-aea17928-d8f4-48d7-ab91-ea7dfd202e50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048404 Jun 21 03:17:12.596073 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 428/857] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:17:12.779799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:12.780611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:12.782636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:12.783024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:12.788735 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:12.789147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:12.789932 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:12.790517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:12.793567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:12.795774 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:12.796982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8db21223-48d9-4cd7-8c5b-6c4d17cdd52a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.452700 Jun 21 03:17:12.797970 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 430/858] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:12 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:12.946041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:12.953569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d5a17bb9-558b-495d-be05-d5c7b164a276 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.177932 Jun 21 03:17:12.954060 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 429/859] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:12 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:13.084613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:13.085229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:13.091562 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.092002 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.092789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.093216 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.226963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:13.234386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-41caa487-712b-4c76-875e-25a335da551f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.153889 Jun 21 03:17:13.234933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 431/860] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:13 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:13.304147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-d031b4fa-57a7-4eb9-b985-845742cb0e01 req-26d134aa-b7a6-4c85-958f-658e183b620e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c2025-ecd4-4f37-96fc-902636d13d87", "name": "network-vif-plugged", "status": "completed", "tag": "1f0d73a5-9166-4b5c-b46f-00e4c3ba58e4"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:13.312842 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-d031b4fa-57a7-4eb9-b985-845742cb0e01 req-26d134aa-b7a6-4c85-958f-658e183b620e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.313272 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-d031b4fa-57a7-4eb9-b985-845742cb0e01 req-26d134aa-b7a6-4c85-958f-658e183b620e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.324915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-d031b4fa-57a7-4eb9-b985-845742cb0e01 req-26d134aa-b7a6-4c85-958f-658e183b620e service nova] Creating event network-vif-plugged:1f0d73a5-9166-4b5c-b46f-00e4c3ba58e4 for instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 on hv-cinder-84684 Jun 21 03:17:13.329707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-d031b4fa-57a7-4eb9-b985-845742cb0e01 req-26d134aa-b7a6-4c85-958f-658e183b620e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029521 Jun 21 03:17:13.330330 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 430/861] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:13.819997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:13.820958 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:13.832496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.833279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.834542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.835226 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.971880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:13.972604 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:13.979001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.979442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.980193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:13.980653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:13.988326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:13.996303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:13.998124 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:13.999245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-225ada3b-467c-47fa-8db0-1c779e48f777 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.186085 Jun 21 03:17:13.999997 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 432/862] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:13 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:14.115606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:14.128391 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ac54c90a-f915-4cf0-8a85-c0bcb1982bf9 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.160900 Jun 21 03:17:14.129177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 431/863] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:13 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:17:14.251898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:14.252536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:14.258862 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:14.259308 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:14.260127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:14.260511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:14.397797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:14.405854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-24528c0e-04a4-47a9-a633-5126413e259c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.158140 Jun 21 03:17:14.406379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 433/864] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:14 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:15.020207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:15.020887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:15.029203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:15.029721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:15.030599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:15.031099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:15.152406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:15.152991 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:15.159716 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:15.160164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:15.160990 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:15.161554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:15.174349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:15.183218 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:15.184742 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:15.185909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-430d0b76-fb1a-4db7-a726-29fbb08c66f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.171291 Jun 21 03:17:15.186480 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 432/865] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:15 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:15.301863 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:15.312675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-54a82c84-a615-4fab-abd2-89c3f645f994 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.165579 Jun 21 03:17:15.313229 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 434/866] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:15 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:15.426487 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:15.427510 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:15.437199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:15.438024 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:15.439353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:15.440143 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:15.611014 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:15.618986 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e1f7f803-00c4-4937-8424-6a814f7fde83 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.198718 Jun 21 03:17:15.619558 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 433/867] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:15 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:16.204262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:16.204908 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:16.212356 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:16.212849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:16.213682 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:16.214130 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:16.329287 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:16.329889 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:16.337444 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:16.338011 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:16.338828 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:16.339326 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:16.425503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:16.433580 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:16.435077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:16.436240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-779afc11-1314-46d4-abe1-0967869ce3a4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.236144 Jun 21 03:17:16.436841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 435/868] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:16 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:16.471374 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:16.479069 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-486c796c-bfdd-4ba2-969a-6c52dbe2345b tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.153675 Jun 21 03:17:16.479631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 434/869] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:16 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:17:16.640883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:16.641739 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:16.648836 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:16.649282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:16.650026 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:16.650451 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:16.840906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:16.849292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff5e663c-7ac2-46e1-a0a6-47ba47486264 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.214935 Jun 21 03:17:16.849865 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 436/870] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:16 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:17.456245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:17.457077 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:17.465692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:17.466282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:17.467265 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:17.467850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:17.489188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:17.495484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:17.496054 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:17.503501 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:17.503944 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:17.504773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:17.505198 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:17.606908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:17.615190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:17.616833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:17.618090 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3698063d-5b17-489d-a535-2ece3f09d457 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.167078 Jun 21 03:17:17.618718 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 435/871] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:17 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:17.643151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:17.648149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:17.655351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e56b5c38-682b-4290-83cc-d135cabed868 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1314 microversion: 2.1 time: 0.163567 Jun 21 03:17:17.655965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 437/872] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:17 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:17.865678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:17.866284 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:17.872622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:17.873080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:17.873823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:17.874250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:18.010451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:18.018110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-90513aa9-316a-4d6e-99de-83d36dc0459e tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.156209 Jun 21 03:17:18.018675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 436/873] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:17 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:18.641922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:18.643034 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:18.650135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:18.650573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:18.651329 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:18.651751 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:18.673988 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:18.674773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:18.681346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:18.681783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:18.682515 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:18.682941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:18.783685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:18.791767 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:18.793284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:18.794432 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f34141b3-9b82-4d95-aeaf-f098df309645 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.159583 Jun 21 03:17:18.794980 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 438/874] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:18 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:18.817616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:18.825107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a2a2ff1e-e108-4cb0-b271-488b22e3d576 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1497 microversion: 2.1 time: 0.155132 Jun 21 03:17:18.825662 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 437/875] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:18 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:19.035940 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:19.036594 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:19.043160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.043651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.044449 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.044887 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.177873 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:19.186723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2bf76958-4556-4553-834a-117ceca2ee66 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.155152 Jun 21 03:17:19.187488 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 439/876] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:19 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:19.342915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:19.343513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:19.350158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.350603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.351472 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.351922 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.362115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-df3e257e-d130-47e7-ad8b-0d2706319405 req-9579d55f-28d6-4b21-b8c3-0a5c08fab584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3491b64-77fe-4354-9999-2313c72376c6", "name": "network-vif-plugged", "status": "completed", "tag": "12563adb-7248-488a-a2fe-6a26eb6579a4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:19.370984 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-df3e257e-d130-47e7-ad8b-0d2706319405 req-9579d55f-28d6-4b21-b8c3-0a5c08fab584 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.371451 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-df3e257e-d130-47e7-ad8b-0d2706319405 req-9579d55f-28d6-4b21-b8c3-0a5c08fab584 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.379481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:17:19.384602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-df3e257e-d130-47e7-ad8b-0d2706319405 req-9579d55f-28d6-4b21-b8c3-0a5c08fab584 service nova] Creating event network-vif-plugged:12563adb-7248-488a-a2fe-6a26eb6579a4 for instance a3491b64-77fe-4354-9999-2313c72376c6 on hv-cinder-84684 Jun 21 03:17:19.389901 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-df3e257e-d130-47e7-ad8b-0d2706319405 req-9579d55f-28d6-4b21-b8c3-0a5c08fab584 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Jun 21 03:17:19.390989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 440/877] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:19.463320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-db25917e-5581-455c-830f-e2bc21a667f5 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 204 len: 0 microversion: 2.1 time: 0.124017 Jun 21 03:17:19.464187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 438/878] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:17:19 2022] DELETE /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:17:19.473123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:19.473810 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:19.479962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.480399 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.481207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.481630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.612262 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:19.618299 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:19.630781 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-17fc286d-acef-4383-bc89-32092689b438 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1503 microversion: 2.1 time: 0.161805 Jun 21 03:17:19.631560 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 441/879] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:19 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:17:19.816618 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:19.817420 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:19.820105 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:19.826031 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.826479 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.827239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:19.827673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:19.966273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:19.975215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:19.976728 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:19.977909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d780cdd6-7ee7-44c0-a26d-38eca5ba67a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.167486 Jun 21 03:17:19.978438 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 439/880] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:19 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:20.204589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:20.205189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:20.207101 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=18 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:20.213345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:20.213988 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:20.214521 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:20.214952 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:20.352291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:20.360026 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6d23a1ca-5c15-4474-aae1-5fa0432936e7 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.159413 Jun 21 03:17:20.360615 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 442/881] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:20 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:20.655359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:20.656167 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:20.663722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:20.664173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:20.664983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:20.665414 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:20.804933 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:20.812808 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0479e98c-2396-4118-aec1-45857d826b6e tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1503 microversion: 2.1 time: 0.162942 Jun 21 03:17:20.813378 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 440/882] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:20 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:21.005062 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:21.006258 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:21.016942 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.017671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.018834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.019259 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.186233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:21.194756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:21.196224 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:21.197415 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6c0ad9f7-01cb-4c8d-8792-1ec5eda58598 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.199123 Jun 21 03:17:21.197965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 443/883] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:20 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:21.377586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:21.378474 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:21.385638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.386080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.386866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.387304 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.571553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:21.579129 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9a9cabfb-c532-4033-86a5-c8b6d31ad22a tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.205466 Jun 21 03:17:21.579703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 441/884] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:21 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:21.669383 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-55472ea9-9f59-4bd8-b4de-7d8941435b05 req-ae13360d-9181-473c-9fd9-7b2780979a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c2025-ecd4-4f37-96fc-902636d13d87", "name": "network-vif-deleted", "tag": "1f0d73a5-9166-4b5c-b46f-00e4c3ba58e4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:21.677928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-55472ea9-9f59-4bd8-b4de-7d8941435b05 req-ae13360d-9181-473c-9fd9-7b2780979a82 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.678360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-55472ea9-9f59-4bd8-b4de-7d8941435b05 req-ae13360d-9181-473c-9fd9-7b2780979a82 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.689351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-55472ea9-9f59-4bd8-b4de-7d8941435b05 req-ae13360d-9181-473c-9fd9-7b2780979a82 service nova] Creating event network-vif-deleted:1f0d73a5-9166-4b5c-b46f-00e4c3ba58e4 for instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 on hv-cinder-84684 Jun 21 03:17:21.694037 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-55472ea9-9f59-4bd8-b4de-7d8941435b05 req-ae13360d-9181-473c-9fd9-7b2780979a82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028315 Jun 21 03:17:21.694626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 444/885] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:21.833146 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:21.833812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:21.841656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.842232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.843280 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:21.843893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:21.913111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:21.922175 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2a64a4cf-6e08-41d2-816e-140c879689ee tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1461 microversion: 2.1 time: 0.094959 Jun 21 03:17:21.922771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 442/886] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:21 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:22.215407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:22.216110 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:22.223018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.223466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.224219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.224764 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.357377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:22.366024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:22.367502 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:22.368877 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-be2c34c6-4408-46e1-a3bf-99aa1e7357c6 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.157722 Jun 21 03:17:22.369797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 445/887] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:22 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:22.595715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:22.596317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:22.603421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.603926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.604723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.605148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.738124 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:22.745952 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0050d112-4663-477e-b2a2-3b70c800fe4f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1367 microversion: 2.1 time: 0.154201 Jun 21 03:17:22.746516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 443/888] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:22 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:22.942384 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:22.942936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:22.949664 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.950105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.950855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.951281 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.982705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:22.983146 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:22.983583 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lazy-loading 'fault' on Instance uuid 9e8c2025-ecd4-4f37-96fc-902636d13d87 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:17:23.028642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c3c140de9d4f208e371999ae70f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40661b95bfb54299a52d803f7997d8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:23.036565 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d6be6406-a871-4e04-b4a2-91481a30058f tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 200 len: 1304 microversion: 2.1 time: 0.099031 Jun 21 03:17:23.037108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 446/889] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:22 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:23.388953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:23.389650 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:23.395906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:23.396359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:23.397135 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:23.397544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:23.542741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:23.550783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:23.552271 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:23.553449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a6aa7db0-3105-49dc-ba2c-4d1746a6d06c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.168687 Jun 21 03:17:23.553997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 444/890] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:23 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:23.765370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:23.766128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:23.772552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:23.772994 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:23.773754 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:23.774202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:23.906717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:23.914828 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ae1c7f48-f010-4866-966f-f2f062744a07 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1557 microversion: 2.1 time: 0.155305 Jun 21 03:17:23.915369 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 447/891] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:23 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:17:23.931833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:23.932332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:23.939132 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:23.939584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:23.940356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:23.940838 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:24.031075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-65e5462d-4c22-4d72-8f02-20da0719380d tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102734 Jun 21 03:17:24.031999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 445/892] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jun 21 03:17:23 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:24.054929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:24.055677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] [instance: 9e8c2025-ecd4-4f37-96fc-902636d13d87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:24.062640 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:24.063093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:24.063862 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:24.064290 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:24.078926 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] HTTP exception thrown: Instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 could not be found. Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Request method failure captured: Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 HTTP/1.1 Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTgZhpJkb5EHC5dZDeCcr0qc56PH_LQUj_8vX6uBtY8F4Aht-Vj4IG5IQVmOGrf51d7vF5h120KqrJjh3qa29N7Krw2SYUUJpGvM7WXZYNULf2sdyhXrm0NGLLvvkj4q9JwncXGaE36uX-NgOcIslKKUfU6OmLlw_KVQ0XZxmZSsZoQ Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 40661b95bfb54299a52d803f7997d8f1 Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesActionsTest-2037603910 Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:17:24.080658 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40661b95bfb54299a52d803f7997d8f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40661b95bfb54299a52d803f7997d8f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40661b95bfb54299a52d803f7997d8f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40661b95bfb54299a52d803f7997d8f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesActionsTest-2037603910 Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 40661b95bfb54299a52d803f7997d8f1 Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesActionsTest-2037603910 Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesActionsTest-2037603910-project Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 04c3c140de9d4f208e371999ae70f11e Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesActionsTest-2037603910-project Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 could not be found. Jun 21 03:17:24.082614 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '9e8c2025-ecd4-4f37-96fc-902636d13d87'} Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 could not be found. Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:17:24.083477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 could not be found. Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 could not be found. Jun 21 03:17:24.084959 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:17:24.086238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] Returning 404 to user: Instance 9e8c2025-ecd4-4f37-96fc-902636d13d87 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:17:24.086238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b2016fbe-9ee8-4a46-b732-01f6c7517958 tempest-VolumesActionsTest-2037603910 tempest-VolumesActionsTest-2037603910-project] 10.222.0.16 "GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87" status: 404 len: 111 microversion: 2.1 time: 0.031594 Jun 21 03:17:24.086238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 448/893] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:17:24 2022] GET /compute/v2.1/servers/9e8c2025-ecd4-4f37-96fc-902636d13d87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:17:24.573027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:24.573739 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:24.579965 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:24.580741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:24.581389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:24.581960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:24.816279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:24.825359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:24.827219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:24.828977 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-eea57924-37b8-4412-a9dd-4efef9ead3a0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.261294 Jun 21 03:17:24.829559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 446/894] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:24 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:25.091295 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-bc7ccaed-1665-4939-ba21-2d72cb8ac981 req-a9767829-cc6e-4466-8e56-f1b97e675268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3491b64-77fe-4354-9999-2313c72376c6", "tag": "12563adb-7248-488a-a2fe-6a26eb6579a4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:25.100894 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-bc7ccaed-1665-4939-ba21-2d72cb8ac981 req-a9767829-cc6e-4466-8e56-f1b97e675268 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:25.101429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-bc7ccaed-1665-4939-ba21-2d72cb8ac981 req-a9767829-cc6e-4466-8e56-f1b97e675268 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:25.112778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-bc7ccaed-1665-4939-ba21-2d72cb8ac981 req-a9767829-cc6e-4466-8e56-f1b97e675268 service nova] Creating event network-changed:12563adb-7248-488a-a2fe-6a26eb6579a4 for instance a3491b64-77fe-4354-9999-2313c72376c6 on hv-cinder-84684 Jun 21 03:17:25.117895 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-bc7ccaed-1665-4939-ba21-2d72cb8ac981 req-a9767829-cc6e-4466-8e56-f1b97e675268 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030209 Jun 21 03:17:25.118535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 449/895] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:25.623828 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-68426c8d-57c9-4ee8-bcbc-7992586781a8 req-002e3d4f-a399-4a50-80de-7e3632279292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "name": "network-vif-plugged", "status": "completed", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:25.634814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-68426c8d-57c9-4ee8-bcbc-7992586781a8 req-002e3d4f-a399-4a50-80de-7e3632279292 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:25.635315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-68426c8d-57c9-4ee8-bcbc-7992586781a8 req-002e3d4f-a399-4a50-80de-7e3632279292 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:25.647935 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-68426c8d-57c9-4ee8-bcbc-7992586781a8 req-002e3d4f-a399-4a50-80de-7e3632279292 service nova] Creating event network-vif-plugged:9c44fe99-d9b0-4a66-9a2b-1d4a42af9261 for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 on hv-cinder-84684 Jun 21 03:17:25.654038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-68426c8d-57c9-4ee8-bcbc-7992586781a8 req-002e3d4f-a399-4a50-80de-7e3632279292 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Jun 21 03:17:25.654788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 447/896] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:25.847855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:25.848666 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:25.857100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:25.857743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:25.858510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:25.858938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:25.995782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:26.004248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:26.005730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:26.006883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-795cc91d-f4c4-4057-bb8b-7a9d1b037c1e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.163526 Jun 21 03:17:26.007437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 450/897] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:25 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:27.030169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:27.031333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:27.042737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:27.043475 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:27.044847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:27.045676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:27.182377 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:27.190865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:27.192355 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:27.193541 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-643f0183-87bb-48b1-8db2-4179d0ea9dcf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.170364 Jun 21 03:17:27.194100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 448/898] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:27 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:28.211766 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:28.212390 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:28.219453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:28.219896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:28.220693 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:28.221120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:28.355059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:28.363438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:28.364955 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:28.366114 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5f3c7c5f-bb85-4f59-b92e-9a1409f93886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.158321 Jun 21 03:17:28.366667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 451/899] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:28 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:29.388937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:29.389841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:29.398409 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:29.398853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:29.399602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:29.400029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:29.543673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:29.552943 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:29.554381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:29.555587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3f75b79f-06b3-4881-9a12-fdb75c20d5a3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.173392 Jun 21 03:17:29.556153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 449/900] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:29 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:30.574330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:30.574939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:30.581898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:30.582335 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:30.583082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:30.583504 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:30.720572 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:30.729249 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:30.730730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:30.731882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d2717130-a518-4c44-85f9-c30b08de4436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.161611 Jun 21 03:17:30.732435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 452/901] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:30 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:31.753107 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:31.753693 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:31.760532 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:31.761093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:31.761873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:31.762324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:31.897512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:31.907328 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:31.909404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:31.910889 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b6bf6044-1b17-453b-984a-f4c4f04614d7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1744 microversion: 2.20 time: 0.162216 Jun 21 03:17:31.911551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 450/902] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:31 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:32.929209 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:32.929816 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:32.945058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:32.945822 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:32.946759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:32.947350 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:33.146193 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:33.165540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:33.168031 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:33.169278 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3085c749-6ec9-4278-8aec-ec77696427f0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.244051 Jun 21 03:17:33.169823 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 453/903] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:32 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:34.191042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:34.191901 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:34.216406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:34.217316 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:34.224506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:34.225339 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:34.332781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:34.545364 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:34.555619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:34.557380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:34.558936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b02a02c4-8cb0-4e18-ad63-527f1dd447bc tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.372007 Jun 21 03:17:34.570884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 451/904] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:34 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:35.583645 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:35.584254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:35.607165 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:35.607922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:35.608701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:35.609317 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:35.906702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:35.922634 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:35.925392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:35.927068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d85f813f-d099-4371-85db-2cf09960b0c7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.348229 Jun 21 03:17:35.927793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 454/905] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:35 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:36.945519 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:36.946764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:36.956860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:36.961113 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:36.962244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:36.962900 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:37.140248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:37.159661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:37.161944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:37.163404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a278b5be-62f1-40c4-9eb5-d1d504f26ed4 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.221832 Jun 21 03:17:37.180531 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 452/906] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:36 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:38.182219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:38.183625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:38.193702 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:38.202556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:38.203338 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:38.203852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:38.371928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:38.382833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:38.384705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:38.386523 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dfc32b4a-e237-443d-ba88-9006a4108246 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.208160 Jun 21 03:17:38.388886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 455/907] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:38 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:39.406860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:39.408239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:39.434206 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:39.434559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:39.441989 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:39.443694 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:39.687949 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:39.698216 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:39.699713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:39.700906 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-769b4de8-b80a-4d2d-8378-57489bef06ed tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.297987 Jun 21 03:17:39.701684 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 453/908] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:39 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:40.719473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:40.720228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:40.727037 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=59 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:40.729459 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:40.730105 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:40.731242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:40.731679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:40.878359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:40.882030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:40.891195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:40.892753 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:40.893967 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-631764fa-939b-4c3a-b141-36f3f7dc806c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.178688 Jun 21 03:17:40.907057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 456/909] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:40 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:41.914954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:41.915586 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:41.926599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:41.927018 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:41.927779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:41.928214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:42.090654 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:42.099714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:42.102649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:42.104025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1f85433b-e42e-4083-9e2b-989cf5e41025 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.195756 Jun 21 03:17:42.105086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 454/910] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:41 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:43.123361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:43.124882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:43.132050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:43.132848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:43.133803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:43.134240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:43.277516 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:43.287883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:43.290142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:43.291508 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-815b7789-9c45-4afd-a246-926f1ce93add tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1739 microversion: 2.20 time: 0.172789 Jun 21 03:17:43.303687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 457/911] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:43 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:44.316940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:44.318318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:44.331005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:17:44.338009 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:44.339914 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:44.342675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:44.343384 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:44.575982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:44.588950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:44.599349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:44.600813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f28a21b6-ea0d-4880-b094-2b7d91820807 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1721 microversion: 2.20 time: 0.287932 Jun 21 03:17:44.612810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 455/912] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:44 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:45.619214 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:45.620564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:45.628130 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:45.628701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:45.629406 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:45.629855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:45.774343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:45.784537 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:45.786326 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:45.787638 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-89d143ea-84ff-4f16-a4be-1452a82c288f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1721 microversion: 2.20 time: 0.172371 Jun 21 03:17:45.788240 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 458/913] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:45 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:46.805832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:46.806456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:46.813394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:46.813835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:46.814730 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:46.815161 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:46.966507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:46.976182 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:46.977824 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:46.979098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5846df43-9b82-4fed-a008-4fd52decbc1b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1724 microversion: 2.20 time: 0.177174 Jun 21 03:17:46.979667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 456/914] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:46 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:46.997765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6d48997-73a3-406b-8669-cc9f0883bbbc"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:46.998847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:47.006054 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.006498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.007265 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.007735 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.342921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-51bf3839-9ca9-4a1d-9116-5e0902ccc4bb tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349551 Jun 21 03:17:47.343662 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 459/915] 10.222.0.16 () {62 vars in 1363 bytes} [Tue Jun 21 03:17:46 2022] POST /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 03:17:47.465452 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:47.465939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:47.472682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.473441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.474207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.474634 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.529140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-af037bc9-2a14-4bb2-a487-32f28e310147 req-f4fe4949-0076-4196-9efb-d41ca0cc7485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "name": "network-vif-unplugged", "status": "completed", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:47.543507 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-af037bc9-2a14-4bb2-a487-32f28e310147 req-f4fe4949-0076-4196-9efb-d41ca0cc7485 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.544206 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-af037bc9-2a14-4bb2-a487-32f28e310147 req-f4fe4949-0076-4196-9efb-d41ca0cc7485 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.557361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.compute.server_external_events [req-af037bc9-2a14-4bb2-a487-32f28e310147 req-f4fe4949-0076-4196-9efb-d41ca0cc7485 service nova] Unable to find a host for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549. Dropping event network-vif-unplugged {{(pid=117664) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 03:17:47.558613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-af037bc9-2a14-4bb2-a487-32f28e310147 req-f4fe4949-0076-4196-9efb-d41ca0cc7485 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033317 Jun 21 03:17:47.559446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 460/916] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 21 03:17:47.796035 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5bb36766-210c-42f4-8203-7963f5c9aa2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-volume_attachments/c6d48997-73a3-406b-8669-cc9f0883bbbc" status: 202 len: 0 microversion: 2.20 time: 0.334401 Jun 21 03:17:47.796787 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 457/917] 10.222.0.16 () {60 vars in 1456 bytes} [Tue Jun 21 03:17:47 2022] DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-volume_attachments/c6d48997-73a3-406b-8669-cc9f0883bbbc => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:17:47.867028 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:47.867592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:47.876505 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.877116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.877921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.878345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.960015 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-33b09b3d-0ac0-4c28-bef2-c222527e3130 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "POST /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/action" status: 202 len: 0 microversion: 2.20 time: 0.096970 Jun 21 03:17:47.963929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 461/918] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jun 21 03:17:47 2022] POST /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:17:47.968771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:47.969488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:47.977317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.977737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:47.978494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:47.978980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:48.148553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:48.156550 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:48.158034 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:48.159239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-855fc5fa-6803-4c85-9fe2-85c4faa7013a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1672 microversion: 2.20 time: 0.194428 Jun 21 03:17:48.159977 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 458/919] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:47 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:49.179538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:49.181909 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:49.190075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:49.190817 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:49.192047 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:49.192692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:49.342410 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:49.351597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:49.354429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:49.356023 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-16595e78-865a-4227-98dd-2762ee21e44e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.182033 Jun 21 03:17:49.356783 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 462/920] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:49 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:50.379709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:50.380738 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:50.391679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:50.392608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:50.393479 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:50.393912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:50.542403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:50.550791 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:50.552262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:50.553437 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-837feabd-cc69-4e9f-9af1-e0cc970d43f5 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.180291 Jun 21 03:17:50.554029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 459/921] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:50 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:51.571375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:51.571969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:51.578953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:51.579391 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:51.580254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:51.580684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:51.727393 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:51.735718 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:51.737350 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:51.738511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eeb8cec9-8c1b-43d9-a5a7-02d2d769754e tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.171141 Jun 21 03:17:51.739108 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 463/922] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:51 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:52.761565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:52.762497 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:52.774293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:52.775092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:52.776341 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:52.777086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:52.979822 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:52.988098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:52.989676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:52.990859 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-18f5d643-80f7-47b9-a2ea-ff76fe5989d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.235806 Jun 21 03:17:52.997931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 460/923] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:52 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:54.010582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:54.011849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:54.019086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:54.019805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:54.020784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:54.021378 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:54.253696 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:54.262649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:54.265149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:54.266363 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-89ef5a0c-f0ed-4261-962b-99e92a66774c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.260747 Jun 21 03:17:54.268532 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 464/924] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:54 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:55.287763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:55.288902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:55.300673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:55.301250 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:55.303140 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:55.303647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:55.484103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:55.492584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:55.494082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:55.495553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f704e31b-0c74-4db7-829c-495f86df7ae0 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.213495 Jun 21 03:17:55.496117 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 461/925] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:55 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:56.514168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:56.514779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:56.522722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:56.523175 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:56.524137 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:56.524607 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:56.667403 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:56.676318 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:56.677893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:56.679315 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-52ca439a-657a-4870-b4c3-02e75055c52c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.169315 Jun 21 03:17:56.679902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 465/926] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:56 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:57.231295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:57.231953 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:57.238681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:57.239130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:57.239888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:57.240320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:57.264596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-03df72e4-04f4-4ffb-85e8-a449618f9665 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/ips" status: 200 len: 144 microversion: 2.1 time: 0.037124 Jun 21 03:17:57.265206 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 462/927] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:17:57 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:17:57.697811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:57.698394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:57.705100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:57.705626 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:57.706414 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:57.706839 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:57.849129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:57.857978 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:57.859802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:57.861247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-777c7750-b8f0-474e-809e-9488d752970a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.167286 Jun 21 03:17:57.861777 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 466/928] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:57 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:58.881055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:17:58.881661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:58.888441 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:58.888913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:58.889668 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:58.890094 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:59.044143 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:59.053091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:59.054738 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:17:59.056004 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3a8805ea-bde4-450d-9d07-f31614447478 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.179003 Jun 21 03:17:59.056753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 463/929] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:17:58 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:17:59.668554 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "463b3536-a436-4749-95f6-5d96b0cb2d05"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:17:59.670843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:17:59.679550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:59.680285 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:59.681447 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:17:59.682207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:17:59.898236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-532701676", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782746954", "security_groups": [{"name": "tempest-secgroup-smoke-1515630251"}], "block_device_mapping_v2": [{"uuid": "397c7539-e016-4f5c-9212-5b2895222550", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65ee22e2-1b27-4fab-b33d-329c4e3c290a"}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:18:00.028979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] validate_networks() for [('65ee22e2-1b27-4fab-b33d-329c4e3c290a', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:18:00.438489 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:18:00.439103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:18:00.439709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:18:00.440118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:18:00.440550 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:18:00.459886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:00.459886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:00.459886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:00.459886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:00.488305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for project 1a43462c60384cecb441ccf14de5672e. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:18:00.493267 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Getting quotas for user 41c4d3bab2164767b8eefcb4427b65b7 and project 1a43462c60384cecb441ccf14de5672e. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:18:00.556531 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:18:00.558938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='397c7539-e016-4f5c-9212-5b2895222550',volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:18:00.706069 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-36e2359c-e843-4b97-b135-4c760964eb97 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811632 Jun 21 03:18:00.707055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 464/930] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:17:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:18:00.712531 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:00.713261 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:00.721176 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:00.721724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:00.722587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:00.723100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:00.888648 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:00.897476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:00.898972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:00.900190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ef778a4a-4ce7-42d9-8c7c-6c6b75e568f1 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.192189 Jun 21 03:18:00.900814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 465/931] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:00 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:00.905285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a210c4f5-59f1-4c1f-9d47-d44687b7974e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:00.905958 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a210c4f5-59f1-4c1f-9d47-d44687b7974e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:00.958761 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a210c4f5-59f1-4c1f-9d47-d44687b7974e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:00.968595 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a210c4f5-59f1-4c1f-9d47-d44687b7974e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1094 microversion: 2.1 time: 0.066479 Jun 21 03:18:00.969809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 466/932] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:00 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:01.920526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:01.921450 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:01.929577 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:01.930122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:01.931309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:01.931947 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:02.077187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:02.079417 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:02.087501 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:02.089029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:02.090194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ebb6edbf-0478-439d-b109-03d67dce66ea tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.174472 Jun 21 03:18:02.090749 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 467/933] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:01 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:18:02.095835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:02.096478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:02.103943 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:02.104398 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:02.105224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:02.105801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:02.172201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:02.180630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7ec3244f-6f19-477d-bc6a-989b039c9859 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.088824 Jun 21 03:18:02.181206 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 468/934] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:02 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:03.109267 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:03.109962 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:03.116872 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:03.117321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:03.118074 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:03.118505 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:03.258701 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:03.267408 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:03.269039 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:03.270363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c4233927-2b12-42fc-b47b-9ebb9ca14436 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.165053 Jun 21 03:18:03.281288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 469/935] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:03 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:03.281288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:03.281288 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:03.283299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:03.283813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:03.284676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:03.287539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:03.358432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:03.366470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b8843f2f-02bc-49d4-8ba5-fb3a32c7f3f0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.094481 Jun 21 03:18:03.367032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 470/936] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:03 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:04.289270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:04.289924 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:04.296865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:04.297314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:04.298162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:04.298786 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:04.439522 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:04.448099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:04.449855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:04.451253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d4135ca5-e3aa-4239-9547-f4f192b30b82 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.165705 Jun 21 03:18:04.452729 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 471/937] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:04 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:04.456755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:04.457353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:04.463642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:04.464091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:04.464870 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:04.465296 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:04.530596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:04.539926 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-08c13337-0184-4cab-a756-74af44f47feb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.087014 Jun 21 03:18:04.540507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 472/938] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:04 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:05.469821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:05.470807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:05.477737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:05.478273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:05.479115 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:05.479647 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:05.639323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:05.647463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:05.648985 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:05.650142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-67d89e16-34b6-4607-b5b3-90ac75ba5f14 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.184375 Jun 21 03:18:05.650753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 473/939] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:05 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:05.655893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:05.656565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:05.663168 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:05.663614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:05.664393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:05.664853 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:05.728460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:05.739064 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2413fb97-88d2-4a85-a13b-e46595ecd649 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.087036 Jun 21 03:18:05.739801 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 474/940] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:05 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:06.668905 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:06.669674 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:06.676908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:06.677359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:06.678160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:06.678599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:06.817891 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:06.826306 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:06.827802 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:06.829037 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-653d4be4-2209-47b1-8397-979a9e33936d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.164250 Jun 21 03:18:06.829703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 475/941] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:06 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:06.834062 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:06.834661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:06.840772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:06.841193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:06.841943 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:06.842381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:06.905972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:06.913958 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-88491d1b-f258-4a1a-9fe8-1cd8afc86ea8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.083278 Jun 21 03:18:06.914516 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 476/942] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:06 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:07.847614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:07.848248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:07.855190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:07.855628 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:07.856440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:07.857079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:08.005464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:08.016778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:08.018555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:08.020235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-13bfb1de-e86c-4a85-83fc-1a6b1b065db8 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.176581 Jun 21 03:18:08.020879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 477/943] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:07 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:08.025493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:08.026307 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:08.033451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:08.033895 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:08.034673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:08.035106 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:08.099750 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:08.107406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2f81d016-44c2-44ae-b338-0967bf85078e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.085612 Jun 21 03:18:08.107964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 478/944] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:08 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:09.041591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:09.042554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:09.050928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:09.051423 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:09.052210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:09.052683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:09.194144 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:09.203411 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:09.205125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:09.206294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9866fb94-4a26-48bc-8402-b8989f102a88 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.170674 Jun 21 03:18:09.206855 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 479/945] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:09 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:09.211354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:09.211923 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:09.218121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:09.218608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:09.219367 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:09.219979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:09.293585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:09.305387 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9315e631-7381-416e-b0eb-e43a9b134ffa tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.097270 Jun 21 03:18:09.306290 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 480/946] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:09 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:09.679416 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=25 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:09.767232 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:10.227702 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:10.228507 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:10.238080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:10.238700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:10.239794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:10.240467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:10.382025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:10.390590 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:10.392148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:10.393356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0394e525-8e2c-4f8b-bfe0-60b837c54762 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.171367 Jun 21 03:18:10.393912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 481/947] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:10 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:10.398698 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:10.399300 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:10.405569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:10.406044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:10.406832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:10.407298 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:10.470088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:10.475735 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:10.478495 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b05947ef-6ea1-4208-afc2-cac51a7262a3 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.083542 Jun 21 03:18:10.478997 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 482/948] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:10 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:11.415972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:11.417130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:11.419762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=8 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:11.429726 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:11.430310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:11.431439 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:11.431876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:11.570489 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:11.583257 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:11.585696 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:11.587547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-295c5275-2f78-421a-962d-70c97d2c5d2f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.178709 Jun 21 03:18:11.588429 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 483/949] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:11 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:11.594772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:11.595375 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:11.601401 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:11.601847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:11.602611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:11.603040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:11.618103 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:11.664954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:11.672621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-46bdc398-066b-4da9-b251-0b1924b1f3c2 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1144 microversion: 2.1 time: 0.083008 Jun 21 03:18:11.673207 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 484/950] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:11 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:12.611847 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:12.612575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:12.620022 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:12.620547 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:12.621376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:12.622164 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:12.756114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:12.764405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:12.765902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:12.767456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8c44012d-501d-40dc-bf96-80dafc6c32bf tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.161452 Jun 21 03:18:12.768048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 485/951] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:12 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:12.772337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:12.772960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:12.778650 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:12.779092 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:12.779833 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:12.780252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:12.845687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:12.853150 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-642dcffb-a801-41cd-a32d-99dd8e609be1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1136 microversion: 2.1 time: 0.084143 Jun 21 03:18:12.853699 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 486/952] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:12 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:13.789883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:13.790978 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:13.801745 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:13.802473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:13.803697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:13.804400 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:13.941211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:13.949293 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:13.950785 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:13.952014 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-419cc609-d986-4b2c-a81d-df88d37f91f2 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.168723 Jun 21 03:18:13.952603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 487/953] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:13 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:13.957068 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:13.957667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:13.963378 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:13.963825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:13.964608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:13.965042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:14.031710 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:14.039641 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e12c6983-59f9-4fd2-b17d-e72c968075d9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1136 microversion: 2.1 time: 0.086087 Jun 21 03:18:14.040300 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 488/954] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:13 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:14.972979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:14.973795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:14.976790 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:14.983893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:14.984539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:14.985706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:14.986174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:15.288528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:15.296869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:15.298332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:15.299484 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-23c332d0-7061-4066-b25b-6d1d534ef789 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.332042 Jun 21 03:18:15.300020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 489/955] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:14 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:15.304332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:15.304983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:15.310756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:15.311193 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:15.311931 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:15.312354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:15.386979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:15.398907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cb4273ca-f0ab-4281-a48a-dca825c80f5f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1136 microversion: 2.1 time: 0.097625 Jun 21 03:18:15.399688 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 490/956] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:15 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1136 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:16.248582 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3e808355-3a01-4c46-bba3-b35b9979b5c3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.584310 Jun 21 03:18:16.249299 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 467/957] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:17:59 2022] POST /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments => generated 194 bytes in 16586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:18:16.319404 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:16.320039 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:16.327115 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:16.327740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:16.328436 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:16.329410 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:16.416280 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:16.417147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:16.427951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:16.429910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:16.430939 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:16.431705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:16.495527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:16.504715 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:16.506212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:16.506350 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:16.507380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1cce0fd0-9da6-4c5f-888c-281b4ae31dd3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.191856 Jun 21 03:18:16.507933 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 491/958] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:16 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:16.513698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0d01d50b-260a-4d31-ac0e-50e1b462482a tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1192 microversion: 2.1 time: 0.102062 Jun 21 03:18:16.514266 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 468/959] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:16 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:18:17.528845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:17.529860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:17.534078 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:17.534684 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:17.537722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:17.538174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:17.538934 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:17.539348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:17.541359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:17.541805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:17.542565 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:17.542999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:17.604532 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:17.612432 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bd880828-5ee4-4f71-a46b-87e6ed42bd42 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1200 microversion: 2.1 time: 0.084041 Jun 21 03:18:17.613073 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 469/960] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:17 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:17.673670 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:17.682020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:17.684099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:17.684747 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4b713d66-6cea-49fc-b2d5-16152b7f403f tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.162307 Jun 21 03:18:17.685283 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 492/961] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:17 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:18.347164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-98f7f09c-edef-4f81-9c4f-586ccb98e589 req-6ae6209f-ce90-4f41-b2a6-10f1c159c368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "name": "network-vif-plugged", "status": "completed", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:18:18.357148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-98f7f09c-edef-4f81-9c4f-586ccb98e589 req-6ae6209f-ce90-4f41-b2a6-10f1c159c368 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:18.357585 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-98f7f09c-edef-4f81-9c4f-586ccb98e589 req-6ae6209f-ce90-4f41-b2a6-10f1c159c368 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:18.372999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-98f7f09c-edef-4f81-9c4f-586ccb98e589 req-6ae6209f-ce90-4f41-b2a6-10f1c159c368 service nova] Creating event network-vif-plugged:9c44fe99-d9b0-4a66-9a2b-1d4a42af9261 for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 on hv-cinder-84684 Jun 21 03:18:18.378935 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-98f7f09c-edef-4f81-9c4f-586ccb98e589 req-6ae6209f-ce90-4f41-b2a6-10f1c159c368 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035582 Jun 21 03:18:18.380213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 470/962] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:18:18.630278 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:18.630880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:18.637543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:18.637989 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:18.638781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:18.639210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:18.703687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:18.704534 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:18.707301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:18.711059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:18.711628 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:18.712480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:18.713119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:18.715954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d642be3b-ec62-48d9-9a95-6ad083894636 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1210 microversion: 2.1 time: 0.089651 Jun 21 03:18:18.716625 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 493/963] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:18 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:18.948498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:18.958219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:18.959723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:18.960982 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6eb2428d-8a42-4fa3-8035-8adb1feba8d3 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.261691 Jun 21 03:18:18.961673 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 471/964] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:18 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 03:18:19.734332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:19.735013 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:19.743535 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:19.743980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:19.744764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:19.745188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:19.881029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:19.889215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a122f721-270b-43b3-93a8-1861e1234be9 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.159100 Jun 21 03:18:19.889756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 494/965] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:19 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:19.979209 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:19.979875 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:19.987202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:19.987573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:19.988346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:19.988801 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:20.109248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-e408d8ad-b3d7-48f1-8e91-07578f70a4a0 req-65c95640-15a7-4b3a-b259-7951a8e02a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47251c2-17ad-41ac-8bc3-c6a54c3d7f67", "tag": "0bcf4551-5832-4971-a998-4265457bc3f1"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:18:20.118672 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-e408d8ad-b3d7-48f1-8e91-07578f70a4a0 req-65c95640-15a7-4b3a-b259-7951a8e02a69 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:20.119113 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-e408d8ad-b3d7-48f1-8e91-07578f70a4a0 req-65c95640-15a7-4b3a-b259-7951a8e02a69 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:20.132169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-e408d8ad-b3d7-48f1-8e91-07578f70a4a0 req-65c95640-15a7-4b3a-b259-7951a8e02a69 service nova] Creating event network-changed:0bcf4551-5832-4971-a998-4265457bc3f1 for instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 on hv-cinder-84684 Jun 21 03:18:20.137312 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-e408d8ad-b3d7-48f1-8e91-07578f70a4a0 req-65c95640-15a7-4b3a-b259-7951a8e02a69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Jun 21 03:18:20.137897 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 495/966] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:18:20.196425 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:20.205077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:20.206602 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:20.207771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-157b913b-821d-4bfa-ac93-b7b4670ec886 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.232509 Jun 21 03:18:20.208392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 472/967] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:19 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:20.908462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:20.909320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:20.918121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:20.918559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:20.919312 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:20.919740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:21.061568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:21.069460 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-215f1880-94a2-409d-9a36-93ef80936247 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.166687 Jun 21 03:18:21.070012 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 496/968] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:20 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:21.226929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:21.228759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:21.236367 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:21.236886 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:21.237843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:21.238303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:21.440765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:21.449852 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:21.451456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:21.453269 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-aecb0a46-abcb-478e-9873-8652693d6761 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1730 microversion: 2.20 time: 0.230621 Jun 21 03:18:21.453849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 473/969] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:21 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:22.089819 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:22.090415 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:22.097373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:22.097821 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:22.098594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:22.099018 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:22.243282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:22.251576 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-922b87de-da7f-49ef-8c41-ce4674c833cb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.165710 Jun 21 03:18:22.252158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 497/970] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:22 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:22.475630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:22.476687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:22.486962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:22.487408 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:22.488166 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:22.488645 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:22.628597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:22.636979 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:22.638685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:22.641635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-392dd8a8-0fde-4afe-b35a-a921b3356fa7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1717 microversion: 2.20 time: 0.171157 Jun 21 03:18:22.645245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 474/971] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:18:22 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:18:23.273565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:23.274670 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:23.285036 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:23.285788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:23.287121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:23.288048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:23.436549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:23.444168 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-53a00228-923e-40f0-97f8-baffdda629d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.178176 Jun 21 03:18:23.444768 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 498/972] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:23 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:24.464924 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:24.465809 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:24.474191 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:24.474641 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:24.475398 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:24.475830 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:24.622064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:24.629670 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e8bf1c72-b5ff-4951-88b0-eb1f8e1a0b12 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.171257 Jun 21 03:18:24.630234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 475/973] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:24 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:25.654717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:25.655740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:25.666965 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:25.667707 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:25.669052 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:25.669741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:25.816709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:25.824451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c085612e-5461-42cf-9c7c-350bdc51af1e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.176294 Jun 21 03:18:25.825047 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 499/974] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:25 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:26.845796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:26.846694 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:26.857790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:26.858522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:26.859864 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:26.860297 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:26.993297 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:27.001880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5371b958-8528-46f3-a6c6-189326d6c3d0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.162820 Jun 21 03:18:27.002412 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 476/975] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:26 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:28.020902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:28.021502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:28.030914 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:28.031548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:28.032332 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:28.032803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:28.178172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:28.186071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-090294db-879e-49fb-9c65-f30fbe8c5438 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.170909 Jun 21 03:18:28.186626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 500/976] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:28 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:29.204538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:29.205095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:29.212070 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:29.212542 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:29.213300 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:29.213723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:29.355517 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:29.363745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ae2c6995-4fd0-4010-a213-bb0b25ab68e0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.163238 Jun 21 03:18:29.364303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 477/977] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:29 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:30.383136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:30.383810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:30.390843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:30.391295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:30.392058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:30.392549 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:30.536921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:30.540470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:30.547803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2e11131c-2da5-43ea-8861-d7512940e2fe tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.168567 Jun 21 03:18:30.548377 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 501/978] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:30 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:31.569097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:31.570151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:31.581145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:31.581593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:31.582350 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:31.582779 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:31.726163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:31.733760 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4e09827c-3638-4186-8125-558c54e88189 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.171207 Jun 21 03:18:31.734314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 478/979] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:31 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:32.750909 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:32.751492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:32.758720 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:32.759160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:32.759910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:32.760338 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:32.895674 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:32.903099 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e40b75bd-1374-490e-b576-fe56075ed737 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1278 microversion: 2.1 time: 0.155987 Jun 21 03:18:32.903656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 502/980] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:32 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:33.345858 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:33.346890 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:33.353643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:33.354096 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:33.354849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:33.355277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:33.384558 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-52e099af-3075-4041-823c-edb65d02422d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042745 Jun 21 03:18:33.385100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 479/981] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:18:33 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:18:33.395649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:33.396187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:33.403457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:33.403899 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:33.404709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:33.405139 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:33.433974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b2060a19-50cc-4ce7-b832-adae9f9a61b9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/463b3536-a436-4749-95f6-5d96b0cb2d05" status: 200 len: 194 microversion: 2.1 time: 0.042841 Jun 21 03:18:33.434539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 503/982] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jun 21 03:18:33 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/463b3536-a436-4749-95f6-5d96b0cb2d05 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:18:33.921038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:33.922359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:33.929534 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:33.930086 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:33.931002 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:33.931492 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:34.064316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:34.073623 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d19040ea-f512-4521-8871-b310509ed675 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.157771 Jun 21 03:18:34.074401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 480/983] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:33 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:34.793136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fc1e6f5-9833-456e-aabc-eb2e118c8e8f"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:18:34.794237 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:34.800865 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:34.801314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:34.802065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:34.802503 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:35.090286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:35.091486 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:35.099158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:35.099592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:35.100347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:35.100948 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:35.189251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7c92103a-00d1-4c5e-ae42-61abef3fb476 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "POST /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400041 Jun 21 03:18:35.190169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 504/984] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:18:34 2022] POST /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:18:35.258456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:35.268765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0306feff-ee40-45b1-a93b-6c3df80924b1 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.182085 Jun 21 03:18:35.269701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 481/985] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:35 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:36.289013 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:36.290111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:36.297896 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:36.298807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:36.299954 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:36.300381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:36.454210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:36.461980 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c2b09497-4a4b-4233-a055-136569684363 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.179948 Jun 21 03:18:36.462551 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 505/986] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:36 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:37.482178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:37.482805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:37.489535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:37.489983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:37.490740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:37.491172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:37.634789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:37.642337 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-21cb0144-a7df-4754-ab40-6de3a696b299 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.164008 Jun 21 03:18:37.642905 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 482/987] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:37 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:38.659056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:38.659781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:38.666645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:38.667047 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:38.668009 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:38.668636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:38.803791 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:38.811324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b0f1d323-92d9-412d-8552-0542d57c1dbf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.156182 Jun 21 03:18:38.811873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 506/988] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:38 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:39.828885 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:39.829500 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:39.832679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=31 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:39.838082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:39.838758 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:39.839429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:39.839864 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:39.842907 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:39.993644 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:40.001907 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-86b0b201-844b-4505-84f2-b4b14ea68367 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.177166 Jun 21 03:18:40.002388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 483/989] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:39 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:41.020829 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:41.021422 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:41.028311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:41.028780 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:41.029543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:41.029976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:41.169870 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:41.177638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-71dc489e-2b6d-4266-888c-e101a17410c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.161453 Jun 21 03:18:41.178174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 507/990] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:41 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:42.195163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:42.195772 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:42.202728 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:42.203172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:42.203927 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:42.204357 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:42.340449 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:42.348883 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1fe9087b-28d8-4651-8ca7-1d0f5366ce4e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.157436 Jun 21 03:18:42.349429 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 484/991] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:42 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:43.374757 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:43.375718 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:43.386994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:43.387746 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:43.389057 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:43.389770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:43.698907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:43.706664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-92c46125-1a4d-477e-a960-358a063dc96d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.338880 Jun 21 03:18:43.707213 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 508/992] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:43 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:44.727744 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:44.728787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:44.739282 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:44.739725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:44.740488 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:44.740953 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:44.933544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:44.941538 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-897c3c1a-7cf0-4dab-8af4-3f36296da455 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.220278 Jun 21 03:18:44.942076 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 485/993] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:44 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:45.961857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:45.962814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:45.966596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=40 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:45.975389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:45.976137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:45.977807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:45.978118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:46.117109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:46.129081 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c1f40c32-54cd-4fb9-bcb6-17e40f1c3bce tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.173454 Jun 21 03:18:46.130045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 509/994] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:45 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:47.146571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:47.147178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:47.154124 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:47.154564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:47.155318 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:47.155741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:47.294405 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:47.303275 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0724edac-6582-4373-8d07-569e9a0c84fb tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.160314 Jun 21 03:18:47.303962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 486/995] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:47 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:48.327331 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:48.328320 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:48.336065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:48.336537 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:48.337279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:48.337706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:48.475285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:48.482850 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5569cf92-722d-4ed9-9c34-09cdab1392d7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.162022 Jun 21 03:18:48.483400 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 510/996] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:48 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:49.504454 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:49.505112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:49.512685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:49.513183 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:49.514012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:49.514491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:49.671601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:49.681252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-281430fb-6755-491c-8912-56f672dd86a0 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.182918 Jun 21 03:18:49.681834 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 487/997] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:49 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:50.703145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:50.704200 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:50.711406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:50.711846 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:50.712621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:50.713049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:50.845255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:50.853065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-80f537c9-ff37-4193-822f-60b5c3d84862 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.156811 Jun 21 03:18:50.853629 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 511/998] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:50 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:51.874973 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:51.875902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:51.883637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:51.884079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:51.884866 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:51.885298 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:52.033433 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:52.041903 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-626d2168-2cb7-4bcd-8c1e-5c8361d52e39 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.173808 Jun 21 03:18:52.042479 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 488/999] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:51 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:53.064230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:53.065438 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:53.072463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:53.072940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:53.073697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:53.074130 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:53.219166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:53.227574 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1eebcc9d-9a69-4e8d-8405-fe7e08598dc8 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.170862 Jun 21 03:18:53.228139 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 512/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:53 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:54.244372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:54.245000 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:54.252044 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:54.252528 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:54.253312 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:54.253738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:54.392725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:54.400178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-83ca403f-a859-4636-a35e-13626729737f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.159750 Jun 21 03:18:54.400733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 489/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:54 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:55.416864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:55.417563 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:55.424584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:55.425016 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:55.425733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:55.426163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:55.558079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:55.565888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c2093b2f-c673-4892-8baf-ac67ae46ced5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.152832 Jun 21 03:18:55.566456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 513/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:55 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:18:56.530145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:56.531068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:56.537720 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.538178 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.538910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.539330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.569018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ab835481-f05e-4309-872a-72b063aa1c7a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042859 Jun 21 03:18:56.569581 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 490/1003] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:18:56 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:18:56.583649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:56.584314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:56.591446 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.591910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.592703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.593140 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.709465 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:56.709947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:56.716149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.716624 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.717371 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.717797 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.730512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:56.738614 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2ddb283c-965a-4e3a-a228-9fbf9c03617f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.159240 Jun 21 03:18:56.739194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 514/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:56 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:56.748637 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a1397bf8-dbf0-4575-a433-383d475887a1 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/463b3536-a436-4749-95f6-5d96b0cb2d05" status: 200 len: 194 microversion: 2.1 time: 0.043295 Jun 21 03:18:56.749241 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 491/1005] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jun 21 03:18:56 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/463b3536-a436-4749-95f6-5d96b0cb2d05 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:18:56.759145 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:56.759645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:56.765844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.766291 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.767040 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:56.767470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:56.849950 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lazy-loading 'services' on Instance uuid 29c98312-5f01-40dc-8fb2-c211c3288a21 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:18:56.927119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a2c216f2-bfbf-4bfa-86ae-65e2c8b9c72b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/463b3536-a436-4749-95f6-5d96b0cb2d05" status: 202 len: 0 microversion: 2.1 time: 0.171620 Jun 21 03:18:56.927631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 515/1006] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:18:56 2022] DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/463b3536-a436-4749-95f6-5d96b0cb2d05 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:18:57.755675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:57.756330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:57.763284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:57.763732 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:57.764521 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:57.764949 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:57.907271 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:57.915567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-38b07564-3559-4685-a36c-d9f99a423118 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.164035 Jun 21 03:18:57.916131 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 492/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:57 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:18:58.938051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:18:58.939182 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:18:58.950305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:58.950920 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:58.952165 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:18:58.952956 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:18:58.969075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:18:59.096774 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:18:59.104463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8947c32d-e331-42e9-841d-9ec03bd9ac30 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.174312 Jun 21 03:18:59.105014 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 516/1008] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:18:58 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:00.121835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:00.122445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:00.129435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:00.129882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:00.130620 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:00.131053 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:00.265628 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:00.274024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-06c0289d-5fbb-4270-9fcd-024afad91458 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.156427 Jun 21 03:19:00.274563 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 493/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:00 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:00.630898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-a4a532ff-af53-4f90-8302-4776878fe6a8 req-54cd6f9b-47ef-4620-b81a-e972cc3fd7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47251c2-17ad-41ac-8bc3-c6a54c3d7f67", "name": "network-vif-plugged", "status": "completed", "tag": "0bcf4551-5832-4971-a998-4265457bc3f1"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:00.640942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-a4a532ff-af53-4f90-8302-4776878fe6a8 req-54cd6f9b-47ef-4620-b81a-e972cc3fd7b5 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:00.641381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-a4a532ff-af53-4f90-8302-4776878fe6a8 req-54cd6f9b-47ef-4620-b81a-e972cc3fd7b5 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:00.653908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-a4a532ff-af53-4f90-8302-4776878fe6a8 req-54cd6f9b-47ef-4620-b81a-e972cc3fd7b5 service nova] Creating event network-vif-plugged:0bcf4551-5832-4971-a998-4265457bc3f1 for instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 on hv-cinder-84684 Jun 21 03:19:00.659173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-a4a532ff-af53-4f90-8302-4776878fe6a8 req-54cd6f9b-47ef-4620-b81a-e972cc3fd7b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031887 Jun 21 03:19:00.659680 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 517/1010] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:01.291172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:01.291880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:01.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:01.299172 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:01.299951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:01.300377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:01.440934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:01.448470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-73fc5d34-c917-4289-87a6-c98691b2b889 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.161236 Jun 21 03:19:01.449038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 494/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:01 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:02.279668 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:02.280245 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:02.287004 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:02.287601 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:02.288526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:02.288962 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:02.318022 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1b1309d0-8aa7-42ec-bb60-28f2a7c00bf2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/7fc1e6f5-9833-456e-aabc-eb2e118c8e8f" status: 200 len: 194 microversion: 2.1 time: 0.043400 Jun 21 03:19:02.318584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 518/1012] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jun 21 03:19:02 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/7fc1e6f5-9833-456e-aabc-eb2e118c8e8f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:02.328908 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:02.329394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:02.335971 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:02.336518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:02.337327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:02.337819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:02.419619 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lazy-loading 'services' on Instance uuid 29c98312-5f01-40dc-8fb2-c211c3288a21 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:19:02.466137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:02.466987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:02.474526 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:02.475059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:02.476093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:02.476780 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:02.507373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-af636693-8d42-421f-9dad-cd5417cc11f2 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/7fc1e6f5-9833-456e-aabc-eb2e118c8e8f" status: 202 len: 0 microversion: 2.1 time: 0.182394 Jun 21 03:19:02.511575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 495/1013] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:19:02 2022] DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments/7fc1e6f5-9833-456e-aabc-eb2e118c8e8f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:19:02.625208 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:02.636493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9d51d328-b237-4e18-ba4e-e65dc20d7b51 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.174134 Jun 21 03:19:02.637125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 519/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:02 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:03.654067 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:03.654761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:03.661814 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:03.662263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:03.663019 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:03.663480 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:03.816933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:03.827230 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3c813038-125d-44ea-b169-a9965fa71b9e tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1266 microversion: 2.1 time: 0.177307 Jun 21 03:19:03.828898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 496/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:03 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:04.845632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:04.846299 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:04.853832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:04.854281 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:04.855052 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:04.855481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.001712 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:05.009656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b55b7135-72a9-4b2d-9357-1b36ae2feddf tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1453 microversion: 2.1 time: 0.168158 Jun 21 03:19:05.010224 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 520/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:04 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:05.025746 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:05.026347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:05.033396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:05.033951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.034709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:05.035141 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.183573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:05.191683 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff27508e-55db-43ba-8030-9d7dd9c70171 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1453 microversion: 2.1 time: 0.169706 Jun 21 03:19:05.192169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 497/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:05 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:05.804734 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:05.805679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:05.812158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:05.812633 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.813388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:05.813820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.843053 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-395ddf5c-0105-467a-b762-387204ce9231 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042226 Jun 21 03:19:05.843592 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 521/1018] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:19:05 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:19:05.952235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:05.953431 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:05.960385 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:05.960881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.961805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:05.962247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:05.996827 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-029d7558-fa9d-4fcb-9e30-8357e0bdda04 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048429 Jun 21 03:19:05.997376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 498/1019] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:19:05 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:19:06.067600 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:06.068192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:06.083027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:06.083473 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:06.084244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:06.084704 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:06.110055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:19:06.203669 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-372c3032-2b37-4d3e-9a76-3e076e13067b tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 204 len: 0 microversion: 2.1 time: 0.143916 Jun 21 03:19:06.204705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 522/1020] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:19:06 2022] DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:19:06.212937 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:06.213552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:06.220426 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:06.221572 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:06.222392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:06.222897 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:06.226513 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:19:06.439910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:06.447733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cafa01b3-8a11-4b3c-80bd-ce3ac5c78eb4 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1673 microversion: 2.1 time: 0.238924 Jun 21 03:19:06.448303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 499/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:06 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1673 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:07.022520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-54de0018-fc97-4c19-9904-820efbd93f25 req-673f6b61-c7b7-4356-ad8f-e67e6df2b9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47251c2-17ad-41ac-8bc3-c6a54c3d7f67", "tag": "0bcf4551-5832-4971-a998-4265457bc3f1"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:07.030483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-54de0018-fc97-4c19-9904-820efbd93f25 req-673f6b61-c7b7-4356-ad8f-e67e6df2b9aa service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:07.030928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-54de0018-fc97-4c19-9904-820efbd93f25 req-673f6b61-c7b7-4356-ad8f-e67e6df2b9aa service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:07.042425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-54de0018-fc97-4c19-9904-820efbd93f25 req-673f6b61-c7b7-4356-ad8f-e67e6df2b9aa service nova] Creating event network-changed:0bcf4551-5832-4971-a998-4265457bc3f1 for instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 on hv-cinder-84684 Jun 21 03:19:07.047298 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-54de0018-fc97-4c19-9904-820efbd93f25 req-673f6b61-c7b7-4356-ad8f-e67e6df2b9aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029681 Jun 21 03:19:07.047810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 523/1022] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:07.465130 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:07.465815 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:07.472855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:07.473379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:07.474133 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:07.474564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:07.631418 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:07.649599 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4c78c283-fbb6-4b87-a633-5bec20eca6f9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1673 microversion: 2.1 time: 0.188169 Jun 21 03:19:07.651525 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 500/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:07 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:08.668154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:08.668784 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:08.675248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:08.675704 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:08.676491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:08.676930 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:08.919093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:08.927648 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e9d26bc6-dae5-4925-ac36-3a721d076192 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1673 microversion: 2.1 time: 0.264110 Jun 21 03:19:08.928248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 524/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:08 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1673 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:09.439437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-95e98d2b-005d-4d7f-88b9-2ecb4014cb2d req-218898fb-675f-4366-9601-d16bc0667898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c98312-5f01-40dc-8fb2-c211c3288a21", "name": "network-vif-deleted", "tag": "9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:09.450766 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-95e98d2b-005d-4d7f-88b9-2ecb4014cb2d req-218898fb-675f-4366-9601-d16bc0667898 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:09.451202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-95e98d2b-005d-4d7f-88b9-2ecb4014cb2d req-218898fb-675f-4366-9601-d16bc0667898 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:09.464147 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-95e98d2b-005d-4d7f-88b9-2ecb4014cb2d req-218898fb-675f-4366-9601-d16bc0667898 service nova] Creating event network-vif-deleted:9a1946f4-b7c7-4af8-ab2c-0b8e4a27a06d for instance 29c98312-5f01-40dc-8fb2-c211c3288a21 on hv-cinder-84684 Jun 21 03:19:09.470188 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-95e98d2b-005d-4d7f-88b9-2ecb4014cb2d req-218898fb-675f-4366-9601-d16bc0667898 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Jun 21 03:19:09.471143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 501/1025] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:09.946603 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:09.947363 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:09.957059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:09.957502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:09.958489 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:09.959110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:09.991316 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:09.991765 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:09.992219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lazy-loading 'fault' on Instance uuid 29c98312-5f01-40dc-8fb2-c211c3288a21 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:19:10.286310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937fff3ec09e4f8a9a9a5fcdf2027a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd05fc495454e9290c277ed4db003d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:10.293631 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1ef71ce6-5e30-4b3f-a33e-747a5adc1342 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 200 len: 1328 microversion: 2.1 time: 0.351009 Jun 21 03:19:10.294210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 525/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:09 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 1328 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:11.315509 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:11.316227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:11.318678 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=38 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:19:11.323986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:11.324491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:11.325258 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:11.325686 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:11.340189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] HTTP exception thrown: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Request method failure captured: Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 HTTP/1.1 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZDbxcN1_F3qYWREviYIM1XC4bk0x3IINWFak0S-caL_ewK543tGZYQPHW62_avpzGe5EgiWPDNSCYBIGjUVAl-GSL2fB7YNCTxxkpwSADSd7W3UVe35XXOGmJ9FO3VytzezKQhO0SvmYq5O-_N4a-BPReRLOnzJHvuu5AnpZAaCv4 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:11.341898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd05fc495454e9290c277ed4db003d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 937fff3ec09e4f8a9a9a5fcdf2027a2b Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:11.343553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '29c98312-5f01-40dc-8fb2-c211c3288a21'} Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:11.344685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:11.346083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:11.347324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Returning 404 to user: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:11.347324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-577fb7ce-7c60-4538-bc37-d63f9566d21d tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 404 len: 111 microversion: 2.1 time: 0.034524 Jun 21 03:19:11.347324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 502/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:11 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:19:11.354451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bf26bd12-ce03-4ad2-a95b-4e6699634b90 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '.version_select at 0x7fe79a13b1f0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:11.376185 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-bf26bd12-ce03-4ad2-a95b-4e6699634b90 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227046273" status: 202 len: 0 microversion: 2.1 time: 0.027280 Jun 21 03:19:11.376835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 526/1028] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jun 21 03:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227046273 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:19:14.283625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:14.284204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:14.291123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:14.291578 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:14.292336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:14.292814 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:14.307064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] HTTP exception thrown: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Request method failure captured: Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 HTTP/1.1 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZDbxcN1_F3qYWREviYIM1XC4bk0x3IINWFak0S-caL_ewK543tGZYQPHW62_avpzGe5EgiWPDNSCYBIGjUVAl-GSL2fB7YNCTxxkpwSADSd7W3UVe35XXOGmJ9FO3VytzezKQhO0SvmYq5O-_N4a-BPReRLOnzJHvuu5AnpZAaCv4 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:14.308643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd05fc495454e9290c277ed4db003d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 937fff3ec09e4f8a9a9a5fcdf2027a2b Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.310195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '29c98312-5f01-40dc-8fb2-c211c3288a21'} Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:14.311160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.312605 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.314058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Returning 404 to user: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:14.314058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-50e8d927-ccf9-4f86-a7f8-4fa9e4f9dcc3 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 404 len: 111 microversion: 2.1 time: 0.030493 Jun 21 03:19:14.314058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 503/1029] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:19:14 2022] DELETE /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:19:14.319498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:14.320098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 29c98312-5f01-40dc-8fb2-c211c3288a21] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:14.326565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:14.326992 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:14.327743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:14.328153 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:14.342596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] HTTP exception thrown: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Request method failure captured: Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 HTTP/1.1 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZDbxcN1_F3qYWREviYIM1XC4bk0x3IINWFak0S-caL_ewK543tGZYQPHW62_avpzGe5EgiWPDNSCYBIGjUVAl-GSL2fB7YNCTxxkpwSADSd7W3UVe35XXOGmJ9FO3VytzezKQhO0SvmYq5O-_N4a-BPReRLOnzJHvuu5AnpZAaCv4 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:19:14.344192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd05fc495454e9290c277ed4db003d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 937fff3ec09e4f8a9a9a5fcdf2027a2b Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.346079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '29c98312-5f01-40dc-8fb2-c211c3288a21'} Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:14.346961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. Jun 21 03:19:14.348435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:14.349748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Returning 404 to user: Instance 29c98312-5f01-40dc-8fb2-c211c3288a21 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:14.349748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-accc58b5-8112-4632-93e5-405606765365 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21" status: 404 len: 111 microversion: 2.1 time: 0.030985 Jun 21 03:19:14.349748 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 527/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:14 2022] GET /compute/v2.1/servers/29c98312-5f01-40dc-8fb2-c211c3288a21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:19:15.489532 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:15.490055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:15.497150 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:15.497589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:15.498372 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:15.498806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:15.512675 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] HTTP exception thrown: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Request method failure captured: Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 HTTP/1.1 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZDbxcN1_F3qYWREviYIM1XC4bk0x3IINWFak0S-caL_ewK543tGZYQPHW62_avpzGe5EgiWPDNSCYBIGjUVAl-GSL2fB7YNCTxxkpwSADSd7W3UVe35XXOGmJ9FO3VytzezKQhO0SvmYq5O-_N4a-BPReRLOnzJHvuu5AnpZAaCv4 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:15.514202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd05fc495454e9290c277ed4db003d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 937fff3ec09e4f8a9a9a5fcdf2027a2b Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.515768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '840c12ba-1c44-43ad-9450-eea9f7b74332'} Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:15.516649 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.518083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.519591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Returning 404 to user: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:15.519591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-12b18eb2-8729-4167-88a8-219c9572cd2a tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 404 len: 111 microversion: 2.1 time: 0.029995 Jun 21 03:19:15.519591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 504/1031] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:19:15 2022] DELETE /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:19:15.524964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:15.525578 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] [instance: 840c12ba-1c44-43ad-9450-eea9f7b74332] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:15.532543 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:15.532987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:15.533809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:15.534217 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:15.547898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] HTTP exception thrown: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Request method failure captured: Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 HTTP/1.1 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZDbxcN1_F3qYWREviYIM1XC4bk0x3IINWFak0S-caL_ewK543tGZYQPHW62_avpzGe5EgiWPDNSCYBIGjUVAl-GSL2fB7YNCTxxkpwSADSd7W3UVe35XXOGmJ9FO3VytzezKQhO0SvmYq5O-_N4a-BPReRLOnzJHvuu5AnpZAaCv4 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:19:15.549616 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd05fc495454e9290c277ed4db003d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd05fc495454e9290c277ed4db003d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 8dd05fc495454e9290c277ed4db003d8 Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-696259949 Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 937fff3ec09e4f8a9a9a5fcdf2027a2b Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeTestJSON-696259949-project Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.551329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '840c12ba-1c44-43ad-9450-eea9f7b74332'} Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:15.552359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. Jun 21 03:19:15.553817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:15.555226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] Returning 404 to user: Instance 840c12ba-1c44-43ad-9450-eea9f7b74332 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:15.555226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6e1b274c-29c8-4d68-b120-ec2ed51d8eb9 tempest-AttachVolumeTestJSON-696259949 tempest-AttachVolumeTestJSON-696259949-project] 10.222.0.16 "GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332" status: 404 len: 111 microversion: 2.1 time: 0.029930 Jun 21 03:19:15.555226 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 528/1032] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:15 2022] GET /compute/v2.1/servers/840c12ba-1c44-43ad-9450-eea9f7b74332 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:19:38.774495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:38.775320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:38.777489 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=5 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:19:38.778226 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=19 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:19:38.785647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:38.786083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:38.786837 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:38.787260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:38.816916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bc5e3bd1-fa4a-438b-bc23-f12a85f9f606 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.047231 Jun 21 03:19:38.817490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 505/1033] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:19:38 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:40.168252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "041cd735-f48f-4c18-8007-fa4c16481c74"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:40.169383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:40.172104 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:19:40.172771 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:19:40.179632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:40.180075 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:40.180856 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:40.181283 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:40.469421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-883bfaf6-e50c-4ad6-8334-ec24a27c0843 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "POST /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304968 Jun 21 03:19:40.470246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 529/1034] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:19:40 2022] POST /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:42.719442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:42.720455 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:42.727279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:42.727733 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:42.728490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:42.728932 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:42.759667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5814bcbb-d971-4a35-908b-c9fef23fa6ab tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044268 Jun 21 03:19:42.760208 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 506/1035] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jun 21 03:19:42 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:42.819102 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:42.819652 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:42.827581 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:42.828049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:42.828877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:42.829317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:42.856149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:19:42.941141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-45a083de-80ce-49fb-93ef-3f4bb64d9a2d tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 204 len: 0 microversion: 2.20 time: 0.126047 Jun 21 03:19:42.941753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 530/1036] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jun 21 03:19:42 2022] DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 03:19:42.950557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:42.951170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:42.957743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:42.958190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:42.958946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:42.959380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:43.100536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:43.112123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:43.113660 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:43.114821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ecc69e2a-3852-4e91-aa17-4817dcf1ed16 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.168434 Jun 21 03:19:43.115377 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 507/1037] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:42 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:19:44.138252 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:44.139435 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:44.151394 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:44.152127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:44.153446 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:44.154185 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:44.306080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:44.314239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:44.315724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:44.316925 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7a0e6963-ffe4-484a-bd2a-8bdd7f0f4ba7 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.185844 Jun 21 03:19:44.317458 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 531/1038] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:44 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:19:45.340169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:45.341168 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:45.351522 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:45.351969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:45.352771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:45.353196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:45.488559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:45.496977 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:45.498549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:45.499701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9f21af5f-6a05-4086-8109-5081db2dee67 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1723 microversion: 2.20 time: 0.166053 Jun 21 03:19:45.500477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 508/1039] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:45 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:19:46.367858 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-c4fd0469-bdb4-4ffe-96b2-c0a12453ed52 req-6b407d65-a1df-4bf7-beb7-2ab0007cd2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc90d8e-e522-4996-93ac-0bde3b2c1549", "name": "network-vif-deleted", "tag": "9c44fe99-d9b0-4a66-9a2b-1d4a42af9261"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:46.380741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-c4fd0469-bdb4-4ffe-96b2-c0a12453ed52 req-6b407d65-a1df-4bf7-beb7-2ab0007cd2a4 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:46.381548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-c4fd0469-bdb4-4ffe-96b2-c0a12453ed52 req-6b407d65-a1df-4bf7-beb7-2ab0007cd2a4 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:46.394770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-c4fd0469-bdb4-4ffe-96b2-c0a12453ed52 req-6b407d65-a1df-4bf7-beb7-2ab0007cd2a4 service nova] Creating event network-vif-deleted:9c44fe99-d9b0-4a66-9a2b-1d4a42af9261 for instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 on hv-cinder-84684 Jun 21 03:19:46.401508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-c4fd0469-bdb4-4ffe-96b2-c0a12453ed52 req-6b407d65-a1df-4bf7-beb7-2ab0007cd2a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218923 Jun 21 03:19:46.407034 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 532/1040] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:46.518323 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:46.518934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:46.525491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:46.525936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:46.526761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:46.527204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:46.559379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:46.559699 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:46.560175 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lazy-loading 'fault' on Instance uuid 4bc90d8e-e522-4996-93ac-0bde3b2c1549 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:19:46.602882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:46.614345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:46.615848 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:46.617046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2359b71a-ddd7-4708-b5a2-77b66627ff7a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1371 microversion: 2.20 time: 0.102906 Jun 21 03:19:46.617597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 509/1041] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:46 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:19:47.641465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:47.643091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:47.649898 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:47.650346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:47.651077 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:47.651541 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:47.684172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:47.684644 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:47.685100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.objects.instance [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lazy-loading 'fault' on Instance uuid 4bc90d8e-e522-4996-93ac-0bde3b2c1549 {{(pid=117663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:19:47.726813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:47.734874 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:47.736723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b778c9e1d53c44edb54b0c94c458e20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5badbc0000cf41beb6fd192462d4eda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:47.737880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1122b166-78f9-4f36-bf6d-df0e4a2c5890 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 200 len: 1371 microversion: 2.20 time: 0.104594 Jun 21 03:19:47.738456 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 533/1042] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:47 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 03:19:48.755515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:48.756149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:48.763073 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:48.763511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:48.764261 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:48.764743 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:48.779826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] HTTP exception thrown: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Request method failure captured: Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 HTTP/1.1 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZIhIHG2l-h10I5xE7shOYMDJ9hFzie2wgobpBBrq2X51CwfYw277DB6pNAi_uZEtlHDOmXgV46nEBXxhDpTq5HAHHUAxX5N2PPrd5xBNvVqoF17DOixNizuJ6L2wLPX30gn4JisTa5zyUrQHUirCwCFhT3MCWbIJ72laMqX05kpx0 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:48.781365 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5badbc0000cf41beb6fd192462d4eda8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: b778c9e1d53c44edb54b0c94c458e20c Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:48.783082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '4bc90d8e-e522-4996-93ac-0bde3b2c1549'} Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:48.784313 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:48.785993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:48.787430 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Returning 404 to user: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:48.787430 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f0791ae4-ef18-49fd-ad76-f463c7c90e18 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 404 len: 111 microversion: 2.20 time: 0.031341 Jun 21 03:19:48.787430 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 510/1043] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:48 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:19:48.791644 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6dcf1b90-c9a1-4d9d-927b-d153150ea28c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '.version_select at 0x7fe79a0cce50>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:48.812087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6dcf1b90-c9a1-4d9d-927b-d153150ea28c tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123699676" status: 204 len: 0 microversion: 2.20 time: 0.024277 Jun 21 03:19:48.812679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 534/1044] 10.222.0.16 () {60 vars in 1261 bytes} [Tue Jun 21 03:19:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123699676 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 03:19:49.151881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:49.152547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:49.158796 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:49.159305 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:49.160163 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:49.160690 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:49.244091 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lazy-loading 'services' on Instance uuid a3491b64-77fe-4354-9999-2313c72376c6 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:19:49.316969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3c01594e-efe4-4557-872e-22d6586152dd tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments/041cd735-f48f-4c18-8007-fa4c16481c74" status: 202 len: 0 microversion: 2.1 time: 0.168844 Jun 21 03:19:49.317738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 511/1045] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:19:49 2022] DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments/041cd735-f48f-4c18-8007-fa4c16481c74 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:19:49.326885 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:49.328873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:49.336971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:49.337414 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:49.338215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:49.338669 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:49.379531 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b2900f30-b42b-49a6-9faf-cf096a856a05 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057222 Jun 21 03:19:49.380449 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 535/1046] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:19:49 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:50.393540 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:50.394765 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:50.402524 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.402962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.403704 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.404127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.438659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e730f960-e141-4285-8fdc-e1fefd2360b5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050858 Jun 21 03:19:50.439225 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 512/1047] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:19:50 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 03:19:50.500269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:50.500823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:50.511178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.511871 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.513038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.513649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.539626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:19:50.593549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:50.594050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:50.600238 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.600723 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.601561 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.602063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.617557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] HTTP exception thrown: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.618689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2123146d-4a4f-41b5-b5f3-7ba59cddd804 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 204 len: 0 microversion: 2.1 time: 0.124810 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Request method failure captured: Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 HTTP/1.1 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZIhIHG2l-h10I5xE7shOYMDJ9hFzie2wgobpBBrq2X51CwfYw277DB6pNAi_uZEtlHDOmXgV46nEBXxhDpTq5HAHHUAxX5N2PPrd5xBNvVqoF17DOixNizuJ6L2wLPX30gn4JisTa5zyUrQHUirCwCFhT3MCWbIJ72laMqX05kpx0 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:50.618946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5badbc0000cf41beb6fd192462d4eda8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: b778c9e1d53c44edb54b0c94c458e20c Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.625082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '4bc90d8e-e522-4996-93ac-0bde3b2c1549'} Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:50.626003 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.627490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.629381 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 536/1048] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:19:50 2022] DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:19:50.629484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Returning 404 to user: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:50.629484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3b70e09d-dddf-486f-ac59-752c47f355db tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 404 len: 111 microversion: 2.20 time: 0.031307 Jun 21 03:19:50.629484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 513/1049] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jun 21 03:19:50 2022] DELETE /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:19:50.629876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:50.629876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:50.635379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:50.636135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: 4bc90d8e-e522-4996-93ac-0bde3b2c1549] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:50.636272 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.636713 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.637737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.638233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.642812 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.643268 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.644219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:50.644722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:50.659047 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] HTTP exception thrown: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Request method failure captured: Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 HTTP/1.1 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTZIhIHG2l-h10I5xE7shOYMDJ9hFzie2wgobpBBrq2X51CwfYw277DB6pNAi_uZEtlHDOmXgV46nEBXxhDpTq5HAHHUAxX5N2PPrd5xBNvVqoF17DOixNizuJ6L2wLPX30gn4JisTa5zyUrQHUirCwCFhT3MCWbIJ72laMqX05kpx0 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:50.660625 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5badbc0000cf41beb6fd192462d4eda8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: b778c9e1d53c44edb54b0c94c458e20c Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.662332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '4bc90d8e-e522-4996-93ac-0bde3b2c1549'} Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:50.663152 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. Jun 21 03:19:50.664535 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:50.665647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Returning 404 to user: Instance 4bc90d8e-e522-4996-93ac-0bde3b2c1549 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:50.665647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a7fff37d-026f-40ea-bd2b-bcc9b8f7e09a tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549" status: 404 len: 111 microversion: 2.20 time: 0.032937 Jun 21 03:19:50.665647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 514/1050] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:50 2022] GET /compute/v2.1/servers/4bc90d8e-e522-4996-93ac-0bde3b2c1549 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:19:50.781402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:50.789054 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dbc7c45a-e2bc-41ea-aabb-63f0dd5bb04f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1681 microversion: 2.1 time: 0.164917 Jun 21 03:19:50.789622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 537/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:50 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:51.806872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:51.807515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:51.807656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:51.808059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:51.814960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:51.815336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:51.815481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:51.815789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:51.816152 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:51.816590 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:51.816734 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:51.817027 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:51.830825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] HTTP exception thrown: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Request method failure captured: Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 HTTP/1.1 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZIhIHG2l-h10I5xE7shOYMDJ9hFzie2wgobpBBrq2X51CwfYw277DB6pNAi_uZEtlHDOmXgV46nEBXxhDpTq5HAHHUAxX5N2PPrd5xBNvVqoF17DOixNizuJ6L2wLPX30gn4JisTa5zyUrQHUirCwCFhT3MCWbIJ72laMqX05kpx0 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:19:51.832723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5badbc0000cf41beb6fd192462d4eda8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: b778c9e1d53c44edb54b0c94c458e20c Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.834251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'bade48e3-65d3-406d-8d36-53e1f560e554'} Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:51.835101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.836568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.838166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Returning 404 to user: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:51.838166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3a83bafe-e45d-4f2b-af72-6586e7f85b45 tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 404 len: 111 microversion: 2.20 time: 0.030337 Jun 21 03:19:51.838166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 538/1052] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jun 21 03:19:51 2022] DELETE /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:19:51.842377 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:51.842972 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] [instance: bade48e3-65d3-406d-8d36-53e1f560e554] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:51.849172 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:51.849619 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:51.850369 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:51.850797 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:51.864721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] HTTP exception thrown: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Request method failure captured: Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 HTTP/1.1 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTZIhIHG2l-h10I5xE7shOYMDJ9hFzie2wgobpBBrq2X51CwfYw277DB6pNAi_uZEtlHDOmXgV46nEBXxhDpTq5HAHHUAxX5N2PPrd5xBNvVqoF17DOixNizuJ6L2wLPX30gn4JisTa5zyUrQHUirCwCFhT3MCWbIJ72laMqX05kpx0 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:19:51.866260 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5badbc0000cf41beb6fd192462d4eda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5badbc0000cf41beb6fd192462d4eda8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 5badbc0000cf41beb6fd192462d4eda8 Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1194371719 Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: b778c9e1d53c44edb54b0c94c458e20c Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1194371719-project Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.867912 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'bade48e3-65d3-406d-8d36-53e1f560e554'} Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:51.869041 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. Jun 21 03:19:51.870928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:19:51.872463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] Returning 404 to user: Instance bade48e3-65d3-406d-8d36-53e1f560e554 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:51.872463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-906baef7-e1dd-4b57-83fc-666b4698229b tempest-AttachVolumeShelveTestJSON-1194371719 tempest-AttachVolumeShelveTestJSON-1194371719-project] 10.222.0.16 "GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554" status: 404 len: 111 microversion: 2.20 time: 0.028911 Jun 21 03:19:51.872463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 539/1053] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jun 21 03:19:51 2022] GET /compute/v2.1/servers/bade48e3-65d3-406d-8d36-53e1f560e554 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:19:51.960977 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:51.969128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a3514da6-12f2-4d10-977c-0c2a2d90e151 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1681 microversion: 2.1 time: 0.165916 Jun 21 03:19:51.969934 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 515/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:51 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:52.986775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:52.987398 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:52.995981 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:52.996513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:52.997426 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:52.998074 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:53.585389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:53.593327 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c6b7f70a-6f22-4b46-9afa-6ce61658e35c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1681 microversion: 2.1 time: 0.610604 Jun 21 03:19:53.593882 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 540/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:52 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1681 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:54.537687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-b42e6c19-226b-442b-b98c-bf410c940f0f req-e10b10a0-39cb-4e0b-995a-5c2ac0c2f247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3491b64-77fe-4354-9999-2313c72376c6", "name": "network-vif-deleted", "tag": "12563adb-7248-488a-a2fe-6a26eb6579a4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:54.550266 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b42e6c19-226b-442b-b98c-bf410c940f0f req-e10b10a0-39cb-4e0b-995a-5c2ac0c2f247 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:54.550707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b42e6c19-226b-442b-b98c-bf410c940f0f req-e10b10a0-39cb-4e0b-995a-5c2ac0c2f247 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:54.576275 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-b42e6c19-226b-442b-b98c-bf410c940f0f req-e10b10a0-39cb-4e0b-995a-5c2ac0c2f247 service nova] Creating event network-vif-deleted:12563adb-7248-488a-a2fe-6a26eb6579a4 for instance a3491b64-77fe-4354-9999-2313c72376c6 on hv-cinder-84684 Jun 21 03:19:54.589737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-b42e6c19-226b-442b-b98c-bf410c940f0f req-e10b10a0-39cb-4e0b-995a-5c2ac0c2f247 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056188 Jun 21 03:19:54.590989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 516/1056] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:54.611321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:54.612049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:54.623934 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:54.629025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:54.629910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:54.634732 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:54.739907 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb9100dcf2a4522840d726d800fe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febf273149c744e08e0f7ea65e44e0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:19:54.749237 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4582fac3-bfb7-4387-8a43-21ae67de112f tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 200 len: 1613 microversion: 2.1 time: 0.142132 Jun 21 03:19:54.755610 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 541/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:54 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 1613 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:19:55.770885 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:55.772662 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:19:55.791712 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:55.796627 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:55.799570 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:19:55.803461 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:19:55.827792 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 HTTP/1.1 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:19:55.830464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:19:55.831868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'a3491b64-77fe-4354-9999-2313c72376c6'} Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:19:55.833092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:19:55.834652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:19:55.836103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:19:55.836103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-028723e0-421d-4add-ba84-4e8b0c25f914 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 404 len: 111 microversion: 2.1 time: 0.068902 Jun 21 03:19:55.836103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 517/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:19:55 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:19:55.844534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7600baa6-cc36-4522-add5-e7dc6c88abd5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '.version_select at 0x7fe79a1dfdc0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:55.889518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7600baa6-cc36-4522-add5-e7dc6c88abd5 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756545987" status: 202 len: 0 microversion: 2.1 time: 0.050358 Jun 21 03:19:55.890311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 542/1059] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jun 21 03:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756545987 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:19:57.370208 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3e6665c8-ad3a-4cdd-9ef8-0de21b10c293 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Action: 'create', calling method: .version_select at 0x7fe79a09eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1210371872"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:19:57.665785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3e6665c8-ad3a-4cdd-9ef8-0de21b10c293 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.422092 Jun 21 03:19:57.666394 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 518/1060] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Jun 21 03:19:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 423 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 03:19:57.677929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d0b5ce23-7f16-4a64-980b-402e2e804fd7 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1ea700>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:57.727883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d0b5ce23-7f16-4a64-980b-402e2e804fd7 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.054370 Jun 21 03:19:57.728668 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 543/1061] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:19:57 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:58.746757 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3abac71b-3d00-4c6a-8cf2-082c766ce944 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1b69d0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:58.802943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3abac71b-3d00-4c6a-8cf2-082c766ce944 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.063664 Jun 21 03:19:58.803519 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 519/1062] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:19:58 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:19:59.818410 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f2f759c8-122b-4331-8188-ef6d2d023739 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a20f9d0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:19:59.866946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f2f759c8-122b-4331-8188-ef6d2d023739 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.054138 Jun 21 03:19:59.867509 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 544/1063] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:19:59 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:00.887673 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-48a11721-2a69-4ae9-8b1c-ce50f3081aa5 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a320af0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:00.937263 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-48a11721-2a69-4ae9-8b1c-ce50f3081aa5 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.056895 Jun 21 03:20:00.937819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 520/1064] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:00 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:01.955219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1ef0354d-688b-40d1-9544-24fc68d181b7 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1eaee0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:02.010359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1ef0354d-688b-40d1-9544-24fc68d181b7 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.062771 Jun 21 03:20:02.011015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 545/1065] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:01 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:03.030256 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-08581933-0ef5-499b-8f92-03ba3440c6cf tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a102310>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:03.084103 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-08581933-0ef5-499b-8f92-03ba3440c6cf tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.063271 Jun 21 03:20:03.084789 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 521/1066] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:03 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:04.098548 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-027da675-349e-4808-8a58-1a6cbc161844 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a138820>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:04.147253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-027da675-349e-4808-8a58-1a6cbc161844 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 346 microversion: 2.1 time: 0.053621 Jun 21 03:20:04.147815 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 546/1067] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:04 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:04.160134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-195a171f-f8b9-41b5-b656-9715396b30c2 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Action: 'create', calling method: .version_select at 0x7fe79a1b6790>, body: {"snapshot": {"volume_id": "3309b96f-37d8-4f9f-914a-54afa89a0d01", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-21618078"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:20:04.186835 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:04.187667 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:04.198029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:04.198504 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:04.199275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:04.199710 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:04.213537 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 HTTP/1.1 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:04.215127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.216763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'a3491b64-77fe-4354-9999-2313c72376c6'} Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:04.217584 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.218851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.220070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:04.220070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-df59884c-1cb5-485d-8240-6d24929ace0c tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 404 len: 111 microversion: 2.1 time: 0.033951 Jun 21 03:20:04.220070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 547/1068] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:20:04 2022] DELETE /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:04.225259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:04.225863 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a3491b64-77fe-4354-9999-2313c72376c6] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:04.232640 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:04.233087 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:04.234001 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:04.234265 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:04.249697 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 HTTP/1.1 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:04.251994 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.253632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'a3491b64-77fe-4354-9999-2313c72376c6'} Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:04.254433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. Jun 21 03:20:04.255875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:04.258042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance a3491b64-77fe-4354-9999-2313c72376c6 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:04.258042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-bb7b84c8-dd82-44f6-ae9d-a2589c7fcba1 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6" status: 404 len: 111 microversion: 2.1 time: 0.032104 Jun 21 03:20:04.258345 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 548/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:20:04 2022] GET /compute/v2.1/servers/a3491b64-77fe-4354-9999-2313c72376c6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:20:04.328028 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-195a171f-f8b9-41b5-b656-9715396b30c2 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.172534 Jun 21 03:20:04.328892 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 522/1070] 10.222.0.16 () {60 vars in 1161 bytes} [Tue Jun 21 03:20:04 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:04.338893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e84b670d-6542-4a4e-b4a9-62816a5f3cc2 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1eac10>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:04.373981 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e84b670d-6542-4a4e-b4a9-62816a5f3cc2 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.038951 Jun 21 03:20:04.374778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 549/1071] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:04 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:04.385121 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-caeb3ae6-4678-498c-9c11-8abdf6b88f9b tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1b6d30>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:04.414204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-caeb3ae6-4678-498c-9c11-8abdf6b88f9b tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.032865 Jun 21 03:20:04.414772 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 523/1072] 10.222.0.16 () {58 vars in 1139 bytes} [Tue Jun 21 03:20:04 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:04.424936 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b48abd5e-2ad9-4b7b-8a71-5213a8a6a09a tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a0ecaf0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:04.455294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b48abd5e-2ad9-4b7b-8a71-5213a8a6a09a tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.033946 Jun 21 03:20:04.455939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 550/1073] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:04 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:20:05.469452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c9d113a4-67c9-4139-b208-0a6fe7a4e268 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a320af0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:05.502408 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c9d113a4-67c9-4139-b208-0a6fe7a4e268 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.038582 Jun 21 03:20:05.502985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 524/1074] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:05 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:06.517052 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-099f9cca-986f-473c-a96f-a9b424cbd07f tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1a4820>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:06.550160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-099f9cca-986f-473c-a96f-a9b424cbd07f tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.039150 Jun 21 03:20:06.550741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 551/1075] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:06 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:07.560136 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=28 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:20:07.560947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:20:07.566880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9b368c22-1906-4e74-9f6b-b2f7e76a602b tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a217160>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:07.602465 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9b368c22-1906-4e74-9f6b-b2f7e76a602b tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.043761 Jun 21 03:20:07.603018 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 525/1076] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:07 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:08.616278 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1bff2d58-5c7e-410f-a2c3-dbe8156b212c tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1ea700>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:08.646229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1bff2d58-5c7e-410f-a2c3-dbe8156b212c tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.035359 Jun 21 03:20:08.646825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 552/1077] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:08 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:09.660790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d202efe4-9175-4885-915b-f01187b36c58 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1024c0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:09.693714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d202efe4-9175-4885-915b-f01187b36c58 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.038299 Jun 21 03:20:09.694303 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 526/1078] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:09 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:10.687776 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.688257 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:10.690314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:20:10.698175 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.698621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.699511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.699993 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.703140 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:20:10.705807 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0c92eca2-a0cc-426f-9ac3-e89a64fd5f99 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1b6790>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.715945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a HTTP/1.1 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:10.717534 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.719032 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a'} Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:10.723754 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.725119 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.726488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:10.726488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f0bd684d-f60d-4cd9-998c-18081c15f8b4 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 404 len: 111 microversion: 2.1 time: 0.035574 Jun 21 03:20:10.726488 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 553/1079] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:20:10 2022] DELETE /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:10.727669 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.728270 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:10.734941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.735349 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.736078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.736689 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.739277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0c92eca2-a0cc-426f-9ac3-e89a64fd5f99 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 286 microversion: 2.1 time: 0.038042 Jun 21 03:20:10.739967 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 527/1080] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:10 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:10.750252 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7a6ecbac-19f9-48c8-bc20-95004245c97b tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a5a55e0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.751525 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a HTTP/1.1 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:10.753231 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.754921 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a'} Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:10.755795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. Jun 21 03:20:10.757315 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.758675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:10.758675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-34142191-f1af-4e1b-9ea6-6c2a8eb02719 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a" status: 404 len: 111 microversion: 2.1 time: 0.030747 Jun 21 03:20:10.758675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 554/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:20:10 2022] GET /compute/v2.1/servers/bbc6bed5-6f9c-44bb-a0ca-d5d25705a11a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:10.762857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.763342 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:10.769279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.769717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.770476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.770904 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.784187 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 HTTP/1.1 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:10.786080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.787677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'a2ebc898-2fa4-4c13-b321-a788afa0bd84'} Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:10.791514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.793027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.794540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:10.794540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-50821f27-9b7e-4a32-a183-87c834e3c2ab tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 404 len: 111 microversion: 2.1 time: 0.028291 Jun 21 03:20:10.794540 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 555/1082] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:20:10 2022] DELETE /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:20:10.795471 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.796070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: a2ebc898-2fa4-4c13-b321-a788afa0bd84] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:10.802325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.802764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.803539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:10.803963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:10.813793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7a6ecbac-19f9-48c8-bc20-95004245c97b tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 202 len: 0 microversion: 2.1 time: 0.067227 Jun 21 03:20:10.814553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 528/1083] 10.222.0.16 () {58 vars in 1253 bytes} [Tue Jun 21 03:20:10 2022] DELETE /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:20:10.819160 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 HTTP/1.1 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:10.820721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.822317 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'a2ebc898-2fa4-4c13-b321-a788afa0bd84'} Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:10.823142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. Jun 21 03:20:10.824892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:10.827343 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance a2ebc898-2fa4-4c13-b321-a788afa0bd84 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:10.827343 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7185a7cd-a8bd-47aa-9b1e-7b95448e5db6 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84" status: 404 len: 111 microversion: 2.1 time: 0.030203 Jun 21 03:20:10.827827 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7a06baad-61b8-4694-8219-93aad5029567 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a6c8040>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:10.827986 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 556/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:20:10 2022] GET /compute/v2.1/servers/a2ebc898-2fa4-4c13-b321-a788afa0bd84 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:10.854717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7a06baad-61b8-4694-8219-93aad5029567 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 200 len: 285 microversion: 2.1 time: 0.035774 Jun 21 03:20:10.855314 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 529/1085] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:10 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:11.868004 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-84e759dd-9472-4eb2-870c-f38238034147 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a181670>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:11.897151 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-84e759dd-9472-4eb2-870c-f38238034147 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] HTTP exception thrown: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-84e759dd-9472-4eb2-870c-f38238034147 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Request method failure captured: Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 HTTP/1.1 Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTjd_VXKC73ZjV9ML9B8RC4tlo0-4-A4C0SWfc8uz8LRJwa12BtaBd3a_ZaXMBDNIzp827GqWXgnnUu2BuTZCGo2GURKMlcgR-VOB-HF4xt2C3rVOuLU1fJlWmnNOpCUwen2YjW9z4bjx60NAyx3DLlZYgtHO5PnKmrrd_c760J0-_k Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:11.900239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e916a2b4aaec4fb0b406e9e0a2ec1ff5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 0f35b7ee19f64c34817a8aabce53283f Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '6c9f0879-127b-42f7-9d05-e0fe452bce12'} Jun 21 03:20:11.901945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. (HTTP 404) (Request-ID: req-70bca993-749d-4b69-a8be-2c033897b15b) Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.902966 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:11.904228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 03:20:11.905975 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-84e759dd-9472-4eb2-870c-f38238034147 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Returning 404 to user: Snapshot 6c9f0879-127b-42f7-9d05-e0fe452bce12 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:11.907425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-84e759dd-9472-4eb2-870c-f38238034147 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12" status: 404 len: 111 microversion: 2.1 time: 0.038073 Jun 21 03:20:11.908434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 557/1086] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jun 21 03:20:11 2022] GET /compute/v2.1/os-snapshots/6c9f0879-127b-42f7-9d05-e0fe452bce12 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:11.910782 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b606610e-884e-47a0-8ffa-a57df3c05392 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1b6af0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:11.968118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:11.968118 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:11.977590 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:11.978047 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:11.979682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:11.980147 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:11.983357 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b606610e-884e-47a0-8ffa-a57df3c05392 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 202 len: 0 microversion: 2.1 time: 0.076545 Jun 21 03:20:11.983911 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 530/1087] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:20:11 2022] DELETE /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:20:11.992896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fddaba4b-0674-41a0-a4bb-141628168320 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a09e040>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:12.001857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 HTTP/1.1 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:12.003714 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.005685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'dc9a9acd-00f9-4181-b4db-70d6ad6930e7'} Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:12.006861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.008530 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.010944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:12.012149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-72ad0250-13ef-451f-aa01-f17d2f3d9229 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 404 len: 111 microversion: 2.1 time: 0.051162 Jun 21 03:20:12.012775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 558/1088] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:20:11 2022] DELETE /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:20:12.022475 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:12.023161 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] [instance: dc9a9acd-00f9-4181-b4db-70d6ad6930e7] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:20:12.029499 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:12.029937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:12.030683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:20:12.031108 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:20:12.041941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fddaba4b-0674-41a0-a4bb-141628168320 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 200 len: 345 microversion: 2.1 time: 0.053096 Jun 21 03:20:12.042531 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 531/1089] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:11 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:20:12.045279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] HTTP exception thrown: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Request method failure captured: Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 HTTP/1.1 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTY-X5G6sqWexsOwtLaqGL-YEo15mQsMG0Ghzv0xpUy6-8F6GbaFugNX0D-mfW-lLt92Bvi8IiWHZRddSWtAjgpR1Tu6a2IlUp6c_-dZSvRD01g4rJSQMdOobJR15RCqtgEr-uSY94IzlPzd2purrO1JYVU-ai4BtiOKs6pfEO6lhc0 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:12.047178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/febf273149c744e08e0f7ea65e44e0d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_febf273149c744e08e0f7ea65e44e0d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: febf273149c744e08e0f7ea65e44e0d9 Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1039709075 Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 5bb9100dcf2a4522840d726d800fe013 Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-AttachVolumeNegativeTest-1039709075-project Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.048864 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'dc9a9acd-00f9-4181-b4db-70d6ad6930e7'} Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:12.049973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. Jun 21 03:20:12.052319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:12.053959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] Returning 404 to user: Instance dc9a9acd-00f9-4181-b4db-70d6ad6930e7 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:12.053959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4b6c676d-cd5f-48b3-914d-f7696592e178 tempest-AttachVolumeNegativeTest-1039709075 tempest-AttachVolumeNegativeTest-1039709075-project] 10.222.0.16 "GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7" status: 404 len: 111 microversion: 2.1 time: 0.031076 Jun 21 03:20:12.053959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 559/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:20:12 2022] GET /compute/v2.1/servers/dc9a9acd-00f9-4181-b4db-70d6ad6930e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:20:13.055506 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b74fe61-0c98-4af2-853f-c79a71f96b49 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a1b60d0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:13.084957 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-0b74fe61-0c98-4af2-853f-c79a71f96b49 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] HTTP exception thrown: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b74fe61-0c98-4af2-853f-c79a71f96b49 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Request method failure captured: Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 HTTP/1.1 Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTjd_VXKC73ZjV9ML9B8RC4tlo0-4-A4C0SWfc8uz8LRJwa12BtaBd3a_ZaXMBDNIzp827GqWXgnnUu2BuTZCGo2GURKMlcgR-VOB-HF4xt2C3rVOuLU1fJlWmnNOpCUwen2YjW9z4bjx60NAyx3DLlZYgtHO5PnKmrrd_c760J0-_k Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:20:13.087059 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e916a2b4aaec4fb0b406e9e0a2ec1ff5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 0f35b7ee19f64c34817a8aabce53283f Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '3309b96f-37d8-4f9f-914a-54afa89a0d01'} Jun 21 03:20:13.088652 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. (HTTP 404) (Request-ID: req-7f039a6b-8a49-421d-9988-7746008d780b) Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.089677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:13.091219 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 03:20:13.092553 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b74fe61-0c98-4af2-853f-c79a71f96b49 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Returning 404 to user: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:13.093976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0b74fe61-0c98-4af2-853f-c79a71f96b49 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 404 len: 109 microversion: 2.1 time: 0.037717 Jun 21 03:20:13.095974 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 532/1091] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:13 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:13.101292 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-48b2cf66-d1c8-425e-b163-26b14c1fef91 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a0b54c0>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:13.148793 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-48b2cf66-d1c8-425e-b163-26b14c1fef91 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] HTTP exception thrown: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-48b2cf66-d1c8-425e-b163-26b14c1fef91 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Request method failure captured: Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 HTTP/1.1 Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTjd_VXKC73ZjV9ML9B8RC4tlo0-4-A4C0SWfc8uz8LRJwa12BtaBd3a_ZaXMBDNIzp827GqWXgnnUu2BuTZCGo2GURKMlcgR-VOB-HF4xt2C3rVOuLU1fJlWmnNOpCUwen2YjW9z4bjx60NAyx3DLlZYgtHO5PnKmrrd_c760J0-_k Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:13.151523 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e916a2b4aaec4fb0b406e9e0a2ec1ff5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 0f35b7ee19f64c34817a8aabce53283f Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '3309b96f-37d8-4f9f-914a-54afa89a0d01'} Jun 21 03:20:13.152944 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. (HTTP 404) (Request-ID: req-bbdf0cc2-b906-414a-94f1-2511a67d2524) Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.153773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 03:20:13.155020 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 03:20:13.156512 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.158321 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-48b2cf66-d1c8-425e-b163-26b14c1fef91 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Returning 404 to user: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:13.160539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-48b2cf66-d1c8-425e-b163-26b14c1fef91 tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 404 len: 109 microversion: 2.1 time: 0.062045 Jun 21 03:20:13.160539 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 560/1092] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:20:13 2022] DELETE /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:13.168790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-749a4ae5-6984-452c-bbda-21b2efd9cb7e tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Calling method '.version_select at 0x7fe79a0cddc0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:13.199064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-749a4ae5-6984-452c-bbda-21b2efd9cb7e tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] HTTP exception thrown: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-749a4ae5-6984-452c-bbda-21b2efd9cb7e tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Request method failure captured: Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 HTTP/1.1 Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTjd_VXKC73ZjV9ML9B8RC4tlo0-4-A4C0SWfc8uz8LRJwa12BtaBd3a_ZaXMBDNIzp827GqWXgnnUu2BuTZCGo2GURKMlcgR-VOB-HF4xt2C3rVOuLU1fJlWmnNOpCUwen2YjW9z4bjx60NAyx3DLlZYgtHO5PnKmrrd_c760J0-_k Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:20:13.201466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e916a2b4aaec4fb0b406e9e0a2ec1ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e916a2b4aaec4fb0b406e9e0a2ec1ff5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: e916a2b4aaec4fb0b406e9e0a2ec1ff5 Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-225248950 Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 0f35b7ee19f64c34817a8aabce53283f Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-225248950-project Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '3309b96f-37d8-4f9f-914a-54afa89a0d01'} Jun 21 03:20:13.203174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. (HTTP 404) (Request-ID: req-e2d4f069-6ffb-4924-8772-ae2f05205ec5) Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.204127 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:13.205375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 03:20:13.206737 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. Jun 21 03:20:13.208936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:13.211474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-749a4ae5-6984-452c-bbda-21b2efd9cb7e tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] Returning 404 to user: Volume 3309b96f-37d8-4f9f-914a-54afa89a0d01 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:13.212709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-749a4ae5-6984-452c-bbda-21b2efd9cb7e tempest-VolumesSnapshotsTestJSON-225248950 tempest-VolumesSnapshotsTestJSON-225248950-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01" status: 404 len: 109 microversion: 2.1 time: 0.048325 Jun 21 03:20:13.213275 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 533/1093] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:13 2022] GET /compute/v2.1/os-volumes/3309b96f-37d8-4f9f-914a-54afa89a0d01 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:14.804937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cc357e60-52d2-416b-bd68-0fdec42354f4 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Action: 'create', calling method: .version_select at 0x7fe79a1811f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1883919515", "metadata": {"Type": "work"}}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cc357e60-52d2-416b-bd68-0fdec42354f4 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Request method failure captured: Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 122 Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTjurbDyjhEuR3A2mYk8bpqLhrCV2z4YseXVf32PnF69rc6_b1OawPcvxtOVD91ffiXr-7Lbf_qm57qZ89lnPmlyzhUUNLz5hmfH1tCvOJybWigWoFPNb90OWOLOxamGaiEBzu5MHph6MQ1g3X5n6KZDQvLv-zZCsaqV7r65_DqU98o Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:14.817239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041f95c615a142acad774b807fc2fff8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041f95c615a142acad774b807fc2fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 6cac4e7f0e1047cf9fa7edc10fa83480 Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1883919515", "metadata": {"Type": "work"}}} Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: Jun 21 03:20:14.819114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1883919515', 'metadata': {'Type': 'work'}}}} Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise error Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:14.820279 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 03:20:14.822465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 03:20:14.823807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 03:20:14.823807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.823807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-cc357e60-52d2-416b-bd68-0fdec42354f4 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:14.823807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-cc357e60-52d2-416b-bd68-0fdec42354f4 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.192486 Jun 21 03:20:14.823807 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 561/1094] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jun 21 03:20:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:20:14.830312 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f3df300-55a3-474f-94d3-6a7f88dec1df tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Action: 'create', calling method: .version_select at 0x7fe79a1b6940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2110910041", "metadata": {"Type": "work"}}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f3df300-55a3-474f-94d3-6a7f88dec1df tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Request method failure captured: Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 120 Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTjurbDyjhEuR3A2mYk8bpqLhrCV2z4YseXVf32PnF69rc6_b1OawPcvxtOVD91ffiXr-7Lbf_qm57qZ89lnPmlyzhUUNLz5hmfH1tCvOJybWigWoFPNb90OWOLOxamGaiEBzu5MHph6MQ1g3X5n6KZDQvLv-zZCsaqV7r65_DqU98o Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:20:14.834388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041f95c615a142acad774b807fc2fff8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041f95c615a142acad774b807fc2fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 6cac4e7f0e1047cf9fa7edc10fa83480 Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2110910041", "metadata": {"Type": "work"}}} Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: Jun 21 03:20:14.835951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2110910041', 'metadata': {'Type': 'work'}}}} Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise error Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi '0' Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:14.836841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 03:20:14.838749 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 03:20:14.840647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 03:20:14.840647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.840647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f3df300-55a3-474f-94d3-6a7f88dec1df tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:14.840647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2f3df300-55a3-474f-94d3-6a7f88dec1df tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009868 Jun 21 03:20:14.840647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 534/1095] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jun 21 03:20:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:20:14.845557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e598d58c-f01c-4385-8f4a-720025cc0d08 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Action: 'create', calling method: .version_select at 0x7fe79a1a4550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-180006905", "metadata": {"Type": "work"}}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e598d58c-f01c-4385-8f4a-720025cc0d08 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Request method failure captured: Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 118 Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTjurbDyjhEuR3A2mYk8bpqLhrCV2z4YseXVf32PnF69rc6_b1OawPcvxtOVD91ffiXr-7Lbf_qm57qZ89lnPmlyzhUUNLz5hmfH1tCvOJybWigWoFPNb90OWOLOxamGaiEBzu5MHph6MQ1g3X5n6KZDQvLv-zZCsaqV7r65_DqU98o Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:14.848492 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041f95c615a142acad774b807fc2fff8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041f95c615a142acad774b807fc2fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 6cac4e7f0e1047cf9fa7edc10fa83480 Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-180006905", "metadata": {"Type": "work"}}} Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: Jun 21 03:20:14.850262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-180006905', 'metadata': {'Type': 'work'}}}} Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise error Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi '' Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:14.851294 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 03:20:14.853233 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 03:20:14.854879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 03:20:14.854879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.854879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e598d58c-f01c-4385-8f4a-720025cc0d08 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:14.854879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e598d58c-f01c-4385-8f4a-720025cc0d08 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008286 Jun 21 03:20:14.854879 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 562/1096] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jun 21 03:20:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 03:20:14.862242 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38d7ab81-abc3-4c7f-aaf4-3d06aae0ab90 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Calling method '.version_select at 0x7fe79a06e790>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:14.902000 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-38d7ab81-abc3-4c7f-aaf4-3d06aae0ab90 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] HTTP exception thrown: Volume tempest-invalid-519459946 could not be found. Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38d7ab81-abc3-4c7f-aaf4-3d06aae0ab90 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Request method failure captured: Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-519459946 HTTP/1.1 Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTjurbDyjhEuR3A2mYk8bpqLhrCV2z4YseXVf32PnF69rc6_b1OawPcvxtOVD91ffiXr-7Lbf_qm57qZ89lnPmlyzhUUNLz5hmfH1tCvOJybWigWoFPNb90OWOLOxamGaiEBzu5MHph6MQ1g3X5n6KZDQvLv-zZCsaqV7r65_DqU98o Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:20:14.903961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041f95c615a142acad774b807fc2fff8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041f95c615a142acad774b807fc2fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 6cac4e7f0e1047cf9fa7edc10fa83480 Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Volume tempest-invalid-519459946 could not be found. Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'tempest-invalid-519459946'} Jun 21 03:20:14.905689 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-519459946 could not be found. (HTTP 404) (Request-ID: req-1b9e621a-1d34-4a69-99c4-0130533dc94e) Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.906842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 03:20:14.908327 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-519459946 could not be found. Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:14.909966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-519459946 could not be found. Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-519459946 could not be found. Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38d7ab81-abc3-4c7f-aaf4-3d06aae0ab90 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Returning 404 to user: Volume tempest-invalid-519459946 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-38d7ab81-abc3-4c7f-aaf4-3d06aae0ab90 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-519459946" status: 404 len: 98 microversion: 2.1 time: 0.047749 Jun 21 03:20:14.911401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 535/1097] 10.222.0.16 () {58 vars in 1214 bytes} [Tue Jun 21 03:20:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-519459946 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 21 03:20:14.920942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-594a8f8c-8ecf-4fcb-bf84-4417063a2e59 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005608 Jun 21 03:20:14.921447 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 563/1098] 10.222.0.16 () {58 vars in 1139 bytes} [Tue Jun 21 03:20:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 03:20:14.931087 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f3f657df-d411-44e3-bc17-00b9b43ec47c tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003874 Jun 21 03:20:14.931564 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 536/1099] 10.222.0.16 () {58 vars in 1136 bytes} [Tue Jun 21 03:20:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 03:20:14.941111 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b4eb1eb9-c5bc-4b14-b015-55de5570ce65 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Calling method '.version_select at 0x7fe79a0ece50>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:15.134727 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-b4eb1eb9-c5bc-4b14-b015-55de5570ce65 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] HTTP exception thrown: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b4eb1eb9-c5bc-4b14-b015-55de5570ce65 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Request method failure captured: Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/os-volumes/99945c57-5b17-4a38-9b31-11d209f43bed HTTP/1.1 Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTjurbDyjhEuR3A2mYk8bpqLhrCV2z4YseXVf32PnF69rc6_b1OawPcvxtOVD91ffiXr-7Lbf_qm57qZ89lnPmlyzhUUNLz5hmfH1tCvOJybWigWoFPNb90OWOLOxamGaiEBzu5MHph6MQ1g3X5n6KZDQvLv-zZCsaqV7r65_DqU98o Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:20:15.137464 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041f95c615a142acad774b807fc2fff8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041f95c615a142acad774b807fc2fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 6cac4e7f0e1047cf9fa7edc10fa83480 Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '99945c57-5b17-4a38-9b31-11d209f43bed'} Jun 21 03:20:15.138826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. (HTTP 404) (Request-ID: req-ff979d98-4223-44e5-8162-8949ffefaabd) Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:15.139673 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 03:20:15.140979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 03:20:15.142181 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. Jun 21 03:20:15.143564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.147557 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b4eb1eb9-c5bc-4b14-b015-55de5570ce65 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Returning 404 to user: Volume 99945c57-5b17-4a38-9b31-11d209f43bed could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:15.148695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b4eb1eb9-c5bc-4b14-b015-55de5570ce65 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/99945c57-5b17-4a38-9b31-11d209f43bed" status: 404 len: 109 microversion: 2.1 time: 0.212429 Jun 21 03:20:15.149918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 564/1100] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jun 21 03:20:14 2022] DELETE /compute/v2.1/os-volumes/99945c57-5b17-4a38-9b31-11d209f43bed => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:20:15.163738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-064f31fa-d04b-4005-9aa2-42372446ade5 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Calling method '.version_select at 0x7fe79a0cdd30>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:20:15.211966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-064f31fa-d04b-4005-9aa2-42372446ade5 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] HTTP exception thrown: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-064f31fa-d04b-4005-9aa2-42372446ade5 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Request method failure captured: Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/os-volumes/920ccaf4-f024-4548-bec8-d5866692b7a1 HTTP/1.1 Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTjurbDyjhEuR3A2mYk8bpqLhrCV2z4YseXVf32PnF69rc6_b1OawPcvxtOVD91ffiXr-7Lbf_qm57qZ89lnPmlyzhUUNLz5hmfH1tCvOJybWigWoFPNb90OWOLOxamGaiEBzu5MHph6MQ1g3X5n6KZDQvLv-zZCsaqV7r65_DqU98o Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:20:15.213969 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041f95c615a142acad774b807fc2fff8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041f95c615a142acad774b807fc2fff8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041f95c615a142acad774b807fc2fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 041f95c615a142acad774b807fc2fff8 Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-1423761127 Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 6cac4e7f0e1047cf9fa7edc10fa83480 Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-1423761127-project Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '920ccaf4-f024-4548-bec8-d5866692b7a1'} Jun 21 03:20:15.215373 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. (HTTP 404) (Request-ID: req-b5051081-f594-4a33-ab23-09df99f66d8a) Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:15.216855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 03:20:15.218386 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 03:20:15.219551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-064f31fa-d04b-4005-9aa2-42372446ade5 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] Returning 404 to user: Volume 920ccaf4-f024-4548-bec8-d5866692b7a1 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-064f31fa-d04b-4005-9aa2-42372446ade5 tempest-VolumesNegativeTest-1423761127 tempest-VolumesNegativeTest-1423761127-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/920ccaf4-f024-4548-bec8-d5866692b7a1" status: 404 len: 109 microversion: 2.1 time: 0.059465 Jun 21 03:20:15.220805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 537/1101] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jun 21 03:20:15 2022] GET /compute/v2.1/os-volumes/920ccaf4-f024-4548-bec8-d5866692b7a1 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:20:35.864488 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:20:35.865118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:20:53.176342 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=11 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:20:53.179564 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=11 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:20:53.516970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-aa3af672-bc6c-45f9-b844-050d606918e6 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Action: 'create', calling method: .version_select at 0x7fe79a138310>, body: {"keypair": {"name": "tempest-TestShelveInstance-2057338031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLpLi6foo3GosYwEixgRTVIyLJOX8pQWXxBzMTLznzoNvLrRltqZ5maa5K7ZGIxWUWHK00kLLGy+rkaGhjFzd6CY8fBtIg375m8GwBfB8aljLHm/oaP87Qdri/GxNkwAA=="}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:20:53.542407 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-aa3af672-bc6c-45f9-b844-050d606918e6 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Getting quotas for project 775518eb8c104022b5acfd12ead0fee5. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:20:53.546995 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-aa3af672-bc6c-45f9-b844-050d606918e6 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Getting quotas for user c3c55aee07d4447489ddedde5972ec58 and project 775518eb8c104022b5acfd12ead0fee5. Resources: {'key_pairs'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:20:53.598431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-aa3af672-bc6c-45f9-b844-050d606918e6 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.423477 Jun 21 03:20:53.608127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 565/1102] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:20:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:04.564951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-911f23cd-b1c1-4a87-9ffd-6fe93a3191d8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Action: 'create', calling method: .version_select at 0x7fe79a06e790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1205730609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC+TB8whAa3ze1apX0B2uwmrk9tWvdoQNfymHn7L1s0fKB5EkVDwvxTvlvjGPuQ7qjVibvdW74fvtEFZlnCGcijrfKf9MIUM/jllB07WFj+AGCEwzm+n1fpIxZ7Oslq3w=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:04.579117 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-911f23cd-b1c1-4a87-9ffd-6fe93a3191d8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Getting quotas for project 5e57658c9c9340adba6ab15050b24e8a. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:21:04.583698 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-911f23cd-b1c1-4a87-9ffd-6fe93a3191d8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Getting quotas for user 994fd8a1975c45a8a65ace3d090d1ff5 and project 5e57658c9c9340adba6ab15050b24e8a. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:21:04.608703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-911f23cd-b1c1-4a87-9ffd-6fe93a3191d8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048600 Jun 21 03:21:04.609302 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 538/1103] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jun 21 03:21:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:04.662244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=4 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:04.663392 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:04.667831 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1605774407", "imageRef": "6ee95563-4f58-45f1-843d-f2da9464d443", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1205730609", "networks": [{"uuid": "04bab0d7-ec3d-4594-a10a-c0d2840f14fd"}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:04.728890 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] validate_networks() for [('04bab0d7-ec3d-4594-a10a-c0d2840f14fd', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:21:05.205987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:21:05.206405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:21:05.206873 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:21:05.207275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:21:05.207684 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:21:05.217569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:05.218007 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:05.218798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:05.219222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:05.237883 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Getting quotas for project 5e57658c9c9340adba6ab15050b24e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:21:05.242154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Getting quotas for user 994fd8a1975c45a8a65ace3d090d1ff5 and project 5e57658c9c9340adba6ab15050b24e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:21:05.254750 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:21:05.256974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ee95563-4f58-45f1-843d-f2da9464d443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:21:05.304318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4f0b7916-2401-4230-98f3-d8f0ba4a9751 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642968 Jun 21 03:21:05.304877 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 566/1104] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:21:05.315160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4005ba71-b33c-4d92-8296-5c34797d9eac tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:05.315770 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4005ba71-b33c-4d92-8296-5c34797d9eac tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:05.369555 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4005ba71-b33c-4d92-8296-5c34797d9eac tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:05.376936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4005ba71-b33c-4d92-8296-5c34797d9eac tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1259 microversion: 2.1 time: 0.065865 Jun 21 03:21:05.377485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 539/1105] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:05 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:06.397514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:06.398406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:06.408570 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:06.409018 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:06.409783 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:06.410216 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:06.482568 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:06.491049 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f7a9c499-c8b4-4fb4-b053-57b1cb6e3fc4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1263 microversion: 2.1 time: 0.099815 Jun 21 03:21:06.491611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 567/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:06 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:07.511965 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:07.512996 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:07.521519 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:07.521961 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:07.522722 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:07.523149 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:07.590630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:07.598584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f4ad9f71-debe-4a58-b859-29f3ec8bbd33 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1263 microversion: 2.1 time: 0.093029 Jun 21 03:21:07.599173 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 540/1107] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:07 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:08.619411 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:08.620380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:08.629502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:08.629943 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:08.630687 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:08.631112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:08.701408 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:08.709703 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-152ee8a5-5b1d-4212-a219-a05c728f1612 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1263 microversion: 2.1 time: 0.097150 Jun 21 03:21:08.710264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 568/1108] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:08 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:09.726719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:09.727316 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:09.734968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:09.735586 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:09.736464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:09.736910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:09.802481 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:09.811710 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a0b46f89-9f75-48a7-af67-d525d217253e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1263 microversion: 2.1 time: 0.088671 Jun 21 03:21:09.812601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 541/1109] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:09 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:10.828946 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:10.829823 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:10.837467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:10.837938 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:10.838701 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:10.839155 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:10.906888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:10.913928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1bc1b91b-0268-4f7c-90ad-737c82148f91 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1263 microversion: 2.1 time: 0.088821 Jun 21 03:21:10.914514 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 569/1110] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:10 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:11.935033 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:11.936050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:11.947166 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:11.947904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:11.949195 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:11.949941 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:12.018680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:12.027112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9c386db5-7cb3-4ae5-a2ce-78617cbeb842 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1263 microversion: 2.1 time: 0.098663 Jun 21 03:21:12.027687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 542/1111] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:11 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:13.045048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:13.046948 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:13.054773 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:13.055509 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:13.056511 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:13.057142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:13.432368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:13.444800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-38a7cf50-8522-4243-ace3-38a404c1fcfc tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.403487 Jun 21 03:21:13.456820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 570/1112] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:13 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:14.462877 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:14.463484 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:14.470392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:14.470835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:14.471587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:14.472008 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:14.608161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:14.616237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ea46effa-d89b-4ad5-983b-2f272140d2ed tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.157151 Jun 21 03:21:14.616981 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 543/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:14 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:21:15.634935 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:15.635769 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:15.638208 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:15.639502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:15.648599 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:15.649192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:15.650221 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:15.650756 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:15.789039 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:15.796741 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f249f682-deb3-4096-a90b-55413cc06978 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.166910 Jun 21 03:21:15.797311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 571/1114] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:15 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:16.814332 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:16.814950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:16.816914 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:16.823248 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:16.823962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:16.824929 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:16.825551 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:17.030324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:17.037906 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2e9e732c-dbd4-4fa2-82a8-92ba998e4a20 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.227592 Jun 21 03:21:17.047647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 544/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:16 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:18.055059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:18.055706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:18.062477 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:18.062928 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:18.063760 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:18.064191 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:18.272941 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:18.281509 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7eaeb6f8-b224-4244-970f-bcb2a622a369 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.230259 Jun 21 03:21:18.282265 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 572/1116] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:18 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:19.298660 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:19.299265 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:19.305809 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:19.306254 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:19.307012 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:19.307439 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:19.489851 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:19.501756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fee1dce6-0951-4723-9467-76f9cfd6a2e4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.207104 Jun 21 03:21:19.502306 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 545/1117] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:19 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:20.520583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:20.521319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:20.532581 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:20.533051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:20.533951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:20.534450 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:20.767478 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:20.780695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8c45d927-3f58-4247-9987-7ec036653e0e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.265413 Jun 21 03:21:20.781413 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 573/1118] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:20 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:21.798767 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:21.799463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:21.806118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:21.806571 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:21.807334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:21.807768 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:21.993563 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:22.001321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-82f206f4-0c55-406e-9929-e51438a6755b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.206677 Jun 21 03:21:22.001910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 546/1119] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:21 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:22.860461 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1056964374", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2057338031", "security_groups": [{"name": "tempest-secgroup-smoke-338596972"}], "networks": [{"uuid": "abd812e3-b0dd-4cff-a66a-a63206802dd9"}], "block_device_mapping_v2": [{"uuid": "ff6707cd-3421-4761-8913-a92a9c90d42a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:22.974351 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] validate_networks() for [('abd812e3-b0dd-4cff-a66a-a63206802dd9', None, None, None, None, None)] {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:21:23.019896 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:23.021125 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:23.031004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:23.031453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:23.032525 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:23.032756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:23.183503 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:23.191692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bb666387-0c25-421f-90e0-14907ab50816 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.177200 Jun 21 03:21:23.192636 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 547/1120] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:23 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:21:23.368485 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:21:23.368911 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:21:23.369376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:21:23.370467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:21:23.370913 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:21:23.380389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:23.380964 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:23.381849 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:23.382268 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:23.399709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Getting quotas for project 775518eb8c104022b5acfd12ead0fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:21:23.403470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Getting quotas for user c3c55aee07d4447489ddedde5972ec58 and project 775518eb8c104022b5acfd12ead0fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:21:23.461844 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:21:23.463851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff6707cd-3421-4761-8913-a92a9c90d42a',volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:21:23.597295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3131a4e3-edf0-4150-82cd-9ade2748f460 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.740684 Jun 21 03:21:23.598309 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 574/1121] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:21:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:21:23.609204 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-30a21202-5e3f-4a3a-b073-ebf7cd2e5215 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:23.609855 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-30a21202-5e3f-4a3a-b073-ebf7cd2e5215 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:23.667055 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-30a21202-5e3f-4a3a-b073-ebf7cd2e5215 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:23.675417 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-30a21202-5e3f-4a3a-b073-ebf7cd2e5215 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1089 microversion: 2.1 time: 0.070433 Jun 21 03:21:23.676388 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 548/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:23 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:24.209717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:24.210432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:24.230666 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:24.231383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:24.232247 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:24.232942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:24.477423 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:24.486925 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-e8fc7b59-8dc9-4e77-99ea-c96c95b2c8d1 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.281686 Jun 21 03:21:24.487585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 575/1123] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:24 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:24.692837 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:24.693494 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:24.703688 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:24.704340 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:24.705351 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:24.705954 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:24.921937 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-f6f2ffe0-2525-4a9d-8698-de2ab2e0e874 req-c46cc40b-5199-4307-9dfd-172c39adc1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:24.944553 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-f6f2ffe0-2525-4a9d-8698-de2ab2e0e874 req-c46cc40b-5199-4307-9dfd-172c39adc1c9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:24.945235 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-f6f2ffe0-2525-4a9d-8698-de2ab2e0e874 req-c46cc40b-5199-4307-9dfd-172c39adc1c9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:24.958263 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-f6f2ffe0-2525-4a9d-8698-de2ab2e0e874 req-c46cc40b-5199-4307-9dfd-172c39adc1c9 service nova] Creating event network-changed:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:21:24.964755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-f6f2ffe0-2525-4a9d-8698-de2ab2e0e874 req-c46cc40b-5199-4307-9dfd-172c39adc1c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046017 Jun 21 03:21:24.966947 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 576/1124] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:21:25.138453 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:25.147496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-041983fc-6fdc-40c7-ab11-62853654f684 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1187 microversion: 2.1 time: 0.458737 Jun 21 03:21:25.158701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 549/1125] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:24 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1187 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:25.511887 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:25.513225 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:25.527501 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:25.527952 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:25.528766 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:25.529405 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:25.735942 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:25.745452 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c96de3ab-6d85-4fd4-b703-126e11533338 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.245100 Jun 21 03:21:25.746400 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 577/1126] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:25 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:26.166333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:26.167057 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:26.174498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:26.174882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:26.175642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:26.176063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:26.313450 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:26.321071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4993f597-0084-4f63-9690-083849c384ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1272 microversion: 2.1 time: 0.158662 Jun 21 03:21:26.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 550/1127] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:26 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:26.762630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:26.763178 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:26.770220 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:26.770659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:26.771431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:26.771845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:26.916679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:26.924440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-54ea5880-4e51-49b9-bc12-6483999d0762 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.165730 Jun 21 03:21:26.924999 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 578/1128] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:26 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:27.338381 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:27.339071 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:27.345912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:27.346355 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:27.347107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:27.347530 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:27.482668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:27.491205 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0cad70ef-59e6-491e-83fd-13f870cab327 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1272 microversion: 2.1 time: 0.156767 Jun 21 03:21:27.491871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 551/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:27 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:27.944353 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:27.945593 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:27.962963 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:27.963813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:27.964788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:27.965681 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:28.292045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:28.322596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c2c80e72-ef2e-46b0-b7d8-fb6437f8166a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.384553 Jun 21 03:21:28.338884 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 579/1130] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:27 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:28.510114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:28.510733 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:28.520274 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:28.521065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:28.522206 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:28.523301 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:28.642118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-5e01f572-b14f-4c3e-852e-419b672d1519 req-0d93ce49-729a-4a17-9c6a-59c2f97b6445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:28.651430 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-5e01f572-b14f-4c3e-852e-419b672d1519 req-0d93ce49-729a-4a17-9c6a-59c2f97b6445 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:28.651943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-5e01f572-b14f-4c3e-852e-419b672d1519 req-0d93ce49-729a-4a17-9c6a-59c2f97b6445 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:28.665842 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-5e01f572-b14f-4c3e-852e-419b672d1519 req-0d93ce49-729a-4a17-9c6a-59c2f97b6445 service nova] Creating event network-changed:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:21:28.671463 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-5e01f572-b14f-4c3e-852e-419b672d1519 req-0d93ce49-729a-4a17-9c6a-59c2f97b6445 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358584 Jun 21 03:21:28.672505 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 552/1131] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:28.773382 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:28.783133 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-db6c5831-957d-4da1-90bf-3b89d04080eb tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.278209 Jun 21 03:21:28.783717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 580/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:28 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:21:29.345467 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:29.346170 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:29.353336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:29.353783 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:29.354546 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:29.354950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:29.492120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:29.501343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1484558f-af96-463b-b1d4-78a2ee715ec4 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.160606 Jun 21 03:21:29.502056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 553/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:29 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:29.802527 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:29.803254 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:29.812819 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:29.813513 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:29.815091 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:29.815683 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:29.963470 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:29.975239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1ba23ebb-374c-4c0a-b7f4-ad0d29ced2e7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.178830 Jun 21 03:21:29.976005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 581/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:29 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:30.519464 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:30.520045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:30.527424 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:30.527871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:30.528740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:30.529082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:30.665584 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:30.674679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-24503d8f-4071-4790-95a7-83b4a147c7f7 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.159839 Jun 21 03:21:30.675228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 554/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:30 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:30.993799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:30.994424 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:31.002325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:31.002767 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:31.003508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:31.003930 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:31.148902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:31.156706 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0565965c-b342-4c16-a319-db727ac3922e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.168442 Jun 21 03:21:31.157259 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 582/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:30 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:31.691245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:31.691976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:31.698148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:31.698587 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:31.699359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:31.699786 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:31.855417 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:31.863099 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6cd6ebd3-51d3-4a92-bb68-e3e5af9264ab tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.175699 Jun 21 03:21:31.863690 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 555/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:31 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:31.892356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-d8024ce3-4d97-4e34-a040-8a5a0042d8f3 req-865ad1c4-c213-4ad3-b6ca-2c8d620e9652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "name": "network-vif-plugged", "status": "completed", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:31.900606 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-d8024ce3-4d97-4e34-a040-8a5a0042d8f3 req-865ad1c4-c213-4ad3-b6ca-2c8d620e9652 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:31.901052 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-d8024ce3-4d97-4e34-a040-8a5a0042d8f3 req-865ad1c4-c213-4ad3-b6ca-2c8d620e9652 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:31.912979 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-d8024ce3-4d97-4e34-a040-8a5a0042d8f3 req-865ad1c4-c213-4ad3-b6ca-2c8d620e9652 service nova] Creating event network-vif-plugged:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:21:31.918051 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-d8024ce3-4d97-4e34-a040-8a5a0042d8f3 req-865ad1c4-c213-4ad3-b6ca-2c8d620e9652 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184865 Jun 21 03:21:31.918649 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 583/1138] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:21:32.174334 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:32.175061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:32.181446 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:32.181899 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:32.182685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:32.183122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:32.322871 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:32.330668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f2ebb764-0a34-4ae8-be9e-da701abe497f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.160580 Jun 21 03:21:32.331227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 556/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:32 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:32.882481 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:32.883121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:32.892100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:32.892575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:32.893322 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:32.893750 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:33.041066 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:33.049046 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-fa984802-204c-46ca-a27c-c65b62d9ba64 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.173399 Jun 21 03:21:33.049893 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 584/1140] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:32 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:33.351460 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:33.352508 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:33.363993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:33.364817 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:33.366082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:33.366812 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:33.506771 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:33.514579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-540a7487-4c67-4643-92d6-d60aacd4c2f7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.169624 Jun 21 03:21:33.515115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 557/1141] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:33 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:34.070065 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:34.071076 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:34.074154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:34.075273 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:34.085775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:34.086517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:34.087772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:34.088541 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:34.095390 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:34.221837 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:34.229340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c9b647c1-8b6c-44b7-bf72-d9b4c96f6a8d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.166049 Jun 21 03:21:34.229872 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 585/1142] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:34 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:34.536023 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:34.536963 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:34.539894 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:34.548761 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:34.549201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:34.549950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:34.550374 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:34.554874 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:34.687069 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:34.694985 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a4bd3a8e-9b07-47e9-9e1a-205c30d2797b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.165594 Jun 21 03:21:34.695520 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 558/1143] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:34 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:35.251017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:35.252038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:35.255738 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:35.265329 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:35.266109 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:35.266839 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:35.267262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:35.403445 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:35.411724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0359472f-97f9-478e-adbd-706f57183901 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.167366 Jun 21 03:21:35.412282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 586/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:35 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:35.716041 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:35.717167 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:35.720925 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:35.730221 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:35.730962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:35.732209 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:35.732988 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:35.880701 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:35.888787 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7aebf917-df26-4733-8f7e-06906c9a5613 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.179201 Jun 21 03:21:35.889324 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 559/1145] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:35 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:36.432494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:36.433380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:36.444308 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:36.445055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:36.446331 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:36.447106 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:36.586654 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:36.597434 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c9867281-01ec-4ba7-9918-03c3f90aa2b6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.171226 Jun 21 03:21:36.598302 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 587/1146] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:36 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:36.907938 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:36.908536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:36.915617 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:36.916100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:36.916902 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:36.917336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:37.059054 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:37.068296 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d936f0f7-4b41-4f22-9371-3a2078a625c0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.164725 Jun 21 03:21:37.068903 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 560/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:36 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:37.621723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:37.622340 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:37.629386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:37.629825 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:37.630951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:37.630951 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:37.797397 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:37.805524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ca016f96-8a3d-4d5f-a350-87992b2e1654 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1359 microversion: 2.1 time: 0.189875 Jun 21 03:21:37.806093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 588/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:37 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:38.085989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:38.086699 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:38.093817 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:38.094302 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:38.095077 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:38.095561 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:38.320870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:38.328714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0d008f88-5ab2-4add-bc85-f3a960c4b628 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.247087 Jun 21 03:21:38.329277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 561/1149] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:38 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:38.822222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:38.822813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:38.829971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:38.830418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:38.831179 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:38.831611 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:38.969357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:38.978973 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2ff90b9c-8416-4bb7-a271-d152b2b6cf7b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1549 microversion: 2.1 time: 0.160574 Jun 21 03:21:38.981283 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 589/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:38 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:38.996457 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:38.997038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:39.004141 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.004667 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.005679 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.006510 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.289843 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:39.290636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:39.297780 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.298228 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.299080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.299908 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.331753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Going to try to terminate instance {{(pid=117663) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:21:39.389857 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:39.400207 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d51fc09-424d-4dd6-9186-21e5db16f204 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1549 microversion: 2.1 time: 0.408034 Jun 21 03:21:39.401567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 562/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:38 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1549 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:39.406604 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-7e4cb43a-668c-43d1-8ac1-a3e33a58dc39 req-44345550-8de2-4a8a-bc7d-988af6f01112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47251c2-17ad-41ac-8bc3-c6a54c3d7f67", "tag": "0bcf4551-5832-4971-a998-4265457bc3f1"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:39.416036 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-7e4cb43a-668c-43d1-8ac1-a3e33a58dc39 req-44345550-8de2-4a8a-bc7d-988af6f01112 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.416820 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-7e4cb43a-668c-43d1-8ac1-a3e33a58dc39 req-44345550-8de2-4a8a-bc7d-988af6f01112 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.425489 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-320fd2b4-d9bc-427f-9812-a5e9a48d48db tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 204 len: 0 microversion: 2.1 time: 0.140069 Jun 21 03:21:39.426190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 590/1152] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:21:39 2022] DELETE /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:21:39.433549 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-7e4cb43a-668c-43d1-8ac1-a3e33a58dc39 req-44345550-8de2-4a8a-bc7d-988af6f01112 service nova] Creating event network-changed:0bcf4551-5832-4971-a998-4265457bc3f1 for instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 on hv-cinder-84684 Jun 21 03:21:39.435383 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:39.436170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:39.439717 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-7e4cb43a-668c-43d1-8ac1-a3e33a58dc39 req-44345550-8de2-4a8a-bc7d-988af6f01112 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036691 Jun 21 03:21:39.440595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 563/1153] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:39.445375 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.446048 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.446233 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:39.446816 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.447238 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.450612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:39.451565 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Searching by: {'deleted': False, 'project_id': '5e57658c9c9340adba6ab15050b24e8a'} {{(pid=117664) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 03:21:39.459121 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.460164 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.461307 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.461930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.551187 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.multi_cell_list [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117664) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 03:21:39.591702 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:39.599757 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-6b4ef1b0-57aa-4c72-8653-03bdf9d0d01d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.172369 Jun 21 03:21:39.604555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 591/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:39 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:39.609635 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:39.610262 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:39.616600 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.617055 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.618196 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.618632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.647114 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-70fa4c1c-f0c7-41cd-b15b-ff91935ec4f5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205152 Jun 21 03:21:39.648051 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 564/1155] 10.222.0.16 () {58 vars in 1124 bytes} [Tue Jun 21 03:21:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:39.657593 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:39.658438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:39.665595 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.666350 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.667342 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:39.667778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:39.764522 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:39.773278 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8ccfde19-d63a-4c43-9579-8bc1265c4ff5 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1578 microversion: 2.1 time: 0.171329 Jun 21 03:21:39.774093 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 592/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:39 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:39.837420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:39.846291 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4980efb3-d1c0-4f9c-91f9-dcad9616632a tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1549 microversion: 2.1 time: 0.192307 Jun 21 03:21:39.846774 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 565/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:39 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:21:40.616798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:40.618555 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:40.625971 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:40.626698 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:40.627664 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:40.628295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:40.780795 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:40.788717 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dbefd3e1-311e-4eba-b3fe-9b548d9f838c tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.175660 Jun 21 03:21:40.789290 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 593/1158] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:40 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:40.791487 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:40.791966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:40.798916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:40.799387 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:40.800185 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:40.800661 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:40.957697 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:40.971362 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a8e8dead-f21b-4b82-8742-ac7044666fdc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1578 microversion: 2.1 time: 0.180992 Jun 21 03:21:40.975628 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 566/1159] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:40 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:21:41.444984 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aa1666e-2df9-4165-b11c-049d13e42100"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:41.446661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:41.454504 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:41.455303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:41.458690 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:41.459311 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:41.780569 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-467dce71-87b1-4fb1-bdc2-8e55ba005f57 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341066 Jun 21 03:21:41.786230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 594/1160] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jun 21 03:21:41 2022] POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:41.806536 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:41.807784 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:41.821095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:41.822021 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:41.825360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:41.825881 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:41.909389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-53137c3f-ec43-42b9-b0b7-6707ed8fad64 req-6d8364dd-c9c1-4010-a3b8-f37895ee1328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "name": "network-vif-plugged", "status": "completed", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:41.922112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-53137c3f-ec43-42b9-b0b7-6707ed8fad64 req-6d8364dd-c9c1-4010-a3b8-f37895ee1328 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:41.923061 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-53137c3f-ec43-42b9-b0b7-6707ed8fad64 req-6d8364dd-c9c1-4010-a3b8-f37895ee1328 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:41.936798 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-53137c3f-ec43-42b9-b0b7-6707ed8fad64 req-6d8364dd-c9c1-4010-a3b8-f37895ee1328 service nova] Creating event network-vif-plugged:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:21:41.942721 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-53137c3f-ec43-42b9-b0b7-6707ed8fad64 req-6d8364dd-c9c1-4010-a3b8-f37895ee1328 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039039 Jun 21 03:21:41.943495 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 595/1161] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:21:41.989174 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:41.989875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:42.009098 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:42.009638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:42.010416 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:42.010876 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:42.033283 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:42.042928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ba1d635e-729e-4788-97e6-626c7a597ab9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.241292 Jun 21 03:21:42.043511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 567/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:41 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:42.148223 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:42.149966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-fad11aa1-677f-47e0-8cb6-a1a32c2cd072 req-5f87412f-c53f-4b47-9c9c-6f21c4f1bdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47251c2-17ad-41ac-8bc3-c6a54c3d7f67", "name": "network-vif-deleted", "tag": "0bcf4551-5832-4971-a998-4265457bc3f1"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:42.156264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-aaf791e6-3f3a-4041-aea9-153c948785e4 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1391 microversion: 2.1 time: 0.171159 Jun 21 03:21:42.157348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 596/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:41 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:42.164331 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-fad11aa1-677f-47e0-8cb6-a1a32c2cd072 req-5f87412f-c53f-4b47-9c9c-6f21c4f1bdc4 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:42.164921 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-fad11aa1-677f-47e0-8cb6-a1a32c2cd072 req-5f87412f-c53f-4b47-9c9c-6f21c4f1bdc4 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:42.180279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-fad11aa1-677f-47e0-8cb6-a1a32c2cd072 req-5f87412f-c53f-4b47-9c9c-6f21c4f1bdc4 service nova] Creating event network-vif-deleted:0bcf4551-5832-4971-a998-4265457bc3f1 for instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 on hv-cinder-84684 Jun 21 03:21:42.186474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-fad11aa1-677f-47e0-8cb6-a1a32c2cd072 req-5f87412f-c53f-4b47-9c9c-6f21c4f1bdc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041794 Jun 21 03:21:42.186868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 568/1164] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:43.059008 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:43.059583 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:43.066612 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:43.067059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:43.067808 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:43.068271 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:43.176158 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:43.177490 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:43.184336 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:43.184903 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:43.185685 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:43.186123 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:43.209120 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:43.218677 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-92e541f2-59ff-488c-b325-33d1d85243d0 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1260 microversion: 2.1 time: 0.163391 Jun 21 03:21:43.221270 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:43.221725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:43.222176 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lazy-loading 'fault' on Instance uuid b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:21:43.225310 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 597/1165] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:43 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:43.270095 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:43.278349 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-970cdb71-be47-4b87-a8de-2b34c3baad46 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 200 len: 1230 microversion: 2.1 time: 0.108140 Jun 21 03:21:43.278951 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 569/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:43 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:44.236014 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:44.236751 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:44.243902 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:44.244450 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:44.245362 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:44.245857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:44.296213 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:44.297579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: b47251c2-17ad-41ac-8bc3-c6a54c3d7f67] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:44.303556 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:44.304010 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:44.304778 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:44.305185 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:44.318518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] HTTP exception thrown: Instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 could not be found. Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Request method failure captured: Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 HTTP/1.1 Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTaX6ft6nZczHATaujzDWdpu01FKeiWQCPxVvdt75dOvOQYEh04J4DDR9bAPMO5iv0IuoVU6zKcxk01cDbyFcLszpkvVB8rMvglcLj39mK11KezVXK2nGzoeMdrCbDPOXTzCkp4XWvSQRVq5E36Vm2kwVBR132Iyi6bjYi4KMEn_RRM Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:21:44.320118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a43462c60384cecb441ccf14de5672e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 41c4d3bab2164767b8eefcb4427b65b7 Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 could not be found. Jun 21 03:21:44.321709 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': 'b47251c2-17ad-41ac-8bc3-c6a54c3d7f67'} Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 could not be found. Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:21:44.322543 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 could not be found. Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 could not be found. Jun 21 03:21:44.323915 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:44.326056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Returning 404 to user: Instance b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:21:44.326056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e5f4f72d-918c-42af-bebc-43ed76ae3424 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67" status: 404 len: 111 microversion: 2.1 time: 0.029168 Jun 21 03:21:44.326056 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 570/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:44 2022] GET /compute/v2.1/servers/b47251c2-17ad-41ac-8bc3-c6a54c3d7f67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 03:21:44.383012 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:44.391491 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-735a0a3a-21a2-4143-b5bc-b34c00b98ee5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1444 microversion: 2.1 time: 0.160030 Jun 21 03:21:44.392063 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 598/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:44 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:44.407680 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:44.408295 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:44.414420 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:44.414864 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:44.415618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:44.416035 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:44.547346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:44.555182 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d65368e6-0d45-41ea-bd51-c8b8941005ab tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1444 microversion: 2.1 time: 0.151383 Jun 21 03:21:44.555714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 571/1169] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:44 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:46.429814 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-d9d9cdad-43dc-4d3d-b73f-2631fc6ef0e9 req-43ea0df2-2c7a-44dd-8fb7-6a75ebfb88d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:46.439880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-d9d9cdad-43dc-4d3d-b73f-2631fc6ef0e9 req-43ea0df2-2c7a-44dd-8fb7-6a75ebfb88d5 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:46.440560 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-d9d9cdad-43dc-4d3d-b73f-2631fc6ef0e9 req-43ea0df2-2c7a-44dd-8fb7-6a75ebfb88d5 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:46.452169 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-d9d9cdad-43dc-4d3d-b73f-2631fc6ef0e9 req-43ea0df2-2c7a-44dd-8fb7-6a75ebfb88d5 service nova] Creating event network-changed:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:21:46.458282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-d9d9cdad-43dc-4d3d-b73f-2631fc6ef0e9 req-43ea0df2-2c7a-44dd-8fb7-6a75ebfb88d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032868 Jun 21 03:21:46.459215 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 599/1170] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:47.523885 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:47.524526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:47.526598 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-2fea76b6-4ee0-4587-b61c-8e4fdb29c2d8 req-88b9edd3-acb5-4e87-bf1e-cc348488271a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a28709-3264-4283-8e03-832e6d214e47", "tag": "39a8025d-3186-49e5-8cef-f5a4411ac88f"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:47.532113 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:47.532889 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:47.533901 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:47.534573 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:47.535709 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-2fea76b6-4ee0-4587-b61c-8e4fdb29c2d8 req-88b9edd3-acb5-4e87-bf1e-cc348488271a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:47.536201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-2fea76b6-4ee0-4587-b61c-8e4fdb29c2d8 req-88b9edd3-acb5-4e87-bf1e-cc348488271a service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:47.547029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:47.550056 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-2fea76b6-4ee0-4587-b61c-8e4fdb29c2d8 req-88b9edd3-acb5-4e87-bf1e-cc348488271a service nova] Creating event network-changed:39a8025d-3186-49e5-8cef-f5a4411ac88f for instance 62a28709-3264-4283-8e03-832e6d214e47 on hv-cinder-84684 Jun 21 03:21:47.556759 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-2fea76b6-4ee0-4587-b61c-8e4fdb29c2d8 req-88b9edd3-acb5-4e87-bf1e-cc348488271a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034370 Jun 21 03:21:47.557900 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 600/1171] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:21:47.565292 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:21:47.662918 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d13cb25d-59e8-484a-af03-de090410e9c7 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 204 len: 0 microversion: 2.1 time: 0.142568 Jun 21 03:21:47.664029 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 572/1172] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:21:47 2022] DELETE /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:21:47.673529 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:47.675443 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:47.682800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:47.683323 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:47.684149 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:47.684671 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:47.867501 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:47.877038 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-9f1f2b71-92e6-4d8e-92e2-96ece3d0bfcc tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1576 microversion: 2.1 time: 0.208038 Jun 21 03:21:47.877789 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 601/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:47 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:48.895277 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:48.897552 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:48.903736 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:48.904473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:48.905438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:48.906075 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:49.096585 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:49.104858 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2f412442-0918-4fd0-ac71-cca68ab1868f tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1576 microversion: 2.1 time: 0.213935 Jun 21 03:21:49.105557 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 573/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:48 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:49.767406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-4cf35c8f-9a2a-4627-90d1-1cf4965b1388 req-cf33c44a-cca8-4ac9-af63-232cb27733e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a28709-3264-4283-8e03-832e6d214e47", "name": "network-vif-deleted", "tag": "39a8025d-3186-49e5-8cef-f5a4411ac88f"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:49.780123 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-4cf35c8f-9a2a-4627-90d1-1cf4965b1388 req-cf33c44a-cca8-4ac9-af63-232cb27733e3 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:49.781162 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-4cf35c8f-9a2a-4627-90d1-1cf4965b1388 req-cf33c44a-cca8-4ac9-af63-232cb27733e3 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:49.793621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-4cf35c8f-9a2a-4627-90d1-1cf4965b1388 req-cf33c44a-cca8-4ac9-af63-232cb27733e3 service nova] Creating event network-vif-deleted:39a8025d-3186-49e5-8cef-f5a4411ac88f for instance 62a28709-3264-4283-8e03-832e6d214e47 on hv-cinder-84684 Jun 21 03:21:49.801594 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-4cf35c8f-9a2a-4627-90d1-1cf4965b1388 req-cf33c44a-cca8-4ac9-af63-232cb27733e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038470 Jun 21 03:21:49.802305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 602/1175] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:50.124097 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:50.124968 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:50.128255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:50.133106 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:50.133547 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:50.134320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:50.134759 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:50.187171 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:21:50.241664 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c4d3bab2164767b8eefcb4427b65b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a43462c60384cecb441ccf14de5672e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:50.252404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d43ac60d-2b93-4ce3-87ae-d0ff7240ee6d tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 200 len: 1225 microversion: 2.1 time: 0.132374 Jun 21 03:21:50.253118 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 574/1176] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:50 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 1225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:50.620129 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:50.620859 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:50.627389 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:50.627871 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:50.628648 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:50.629080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:50.765856 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:50.774433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ccfbe24a-e17c-4a8c-88bf-9bfc8cd545c6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1595 microversion: 2.1 time: 0.159186 Jun 21 03:21:50.775376 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 603/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:50 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:51.270788 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:51.271445 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 62a28709-3264-4283-8e03-832e6d214e47] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:51.278173 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:51.278912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:51.279650 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:51.280770 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:51.297038 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] HTTP exception thrown: Instance 62a28709-3264-4283-8e03-832e6d214e47 could not be found. Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Request method failure captured: Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 HTTP/1.1 Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTaX6ft6nZczHATaujzDWdpu01FKeiWQCPxVvdt75dOvOQYEh04J4DDR9bAPMO5iv0IuoVU6zKcxk01cDbyFcLszpkvVB8rMvglcLj39mK11KezVXK2nGzoeMdrCbDPOXTzCkp4XWvSQRVq5E36Vm2kwVBR132Iyi6bjYi4KMEn_RRM Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:21:51.298703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a43462c60384cecb441ccf14de5672e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 41c4d3bab2164767b8eefcb4427b65b7 Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 62a28709-3264-4283-8e03-832e6d214e47 could not be found. Jun 21 03:21:51.300218 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '62a28709-3264-4283-8e03-832e6d214e47'} Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a28709-3264-4283-8e03-832e6d214e47 could not be found. Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:21:51.305107 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a28709-3264-4283-8e03-832e6d214e47 could not be found. Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a28709-3264-4283-8e03-832e6d214e47 could not be found. Jun 21 03:21:51.306544 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.308202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Returning 404 to user: Instance 62a28709-3264-4283-8e03-832e6d214e47 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:21:51.308202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ebef4ee8-44cf-4170-a465-14a2fde52183 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47" status: 404 len: 111 microversion: 2.1 time: 0.034115 Jun 21 03:21:51.308202 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 575/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:51 2022] GET /compute/v2.1/servers/62a28709-3264-4283-8e03-832e6d214e47 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:21:51.782114 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:51.782657 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:51.790021 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:51.790554 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:51.791728 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:51.792244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:51.809007 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] HTTP exception thrown: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Request method failure captured: Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: DELETE /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 HTTP/1.1 Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTaX6ft6nZczHATaujzDWdpu01FKeiWQCPxVvdt75dOvOQYEh04J4DDR9bAPMO5iv0IuoVU6zKcxk01cDbyFcLszpkvVB8rMvglcLj39mK11KezVXK2nGzoeMdrCbDPOXTzCkp4XWvSQRVq5E36Vm2kwVBR132Iyi6bjYi4KMEn_RRM Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:21:51.810781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a43462c60384cecb441ccf14de5672e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 41c4d3bab2164767b8eefcb4427b65b7 Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.812579 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '4150dd80-06fc-4868-a656-f2d72b1552a8'} Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:21:51.816929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.818483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.820044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Returning 404 to user: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:21:51.820044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-29b3c6ee-fe41-4a97-b614-42071f3ae6be tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 404 len: 111 microversion: 2.1 time: 0.034205 Jun 21 03:21:51.820044 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 604/1179] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:21:51 2022] DELETE /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:21:51.821139 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:51.821755 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] [instance: 4150dd80-06fc-4868-a656-f2d72b1552a8] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:51.827874 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:51.828320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:51.829227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:51.829653 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:51.843473 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] HTTP exception thrown: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Request method failure captured: Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 HTTP/1.1 Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTaX6ft6nZczHATaujzDWdpu01FKeiWQCPxVvdt75dOvOQYEh04J4DDR9bAPMO5iv0IuoVU6zKcxk01cDbyFcLszpkvVB8rMvglcLj39mK11KezVXK2nGzoeMdrCbDPOXTzCkp4XWvSQRVq5E36Vm2kwVBR132Iyi6bjYi4KMEn_RRM Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:21:51.845116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a43462c60384cecb441ccf14de5672e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a43462c60384cecb441ccf14de5672e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 1a43462c60384cecb441ccf14de5672e Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1376634511 Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 41c4d3bab2164767b8eefcb4427b65b7 Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1376634511-project Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.846986 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'id': '4150dd80-06fc-4868-a656-f2d72b1552a8'} Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:21:51.849343 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. Jun 21 03:21:51.850966 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:21:51.852354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Returning 404 to user: Instance 4150dd80-06fc-4868-a656-f2d72b1552a8 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:21:51.852354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-386d0110-2845-4c8f-a127-7c0b6f5c9494 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8" status: 404 len: 111 microversion: 2.1 time: 0.029246 Jun 21 03:21:51.852354 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 576/1180] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:51 2022] GET /compute/v2.1/servers/4150dd80-06fc-4868-a656-f2d72b1552a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:21:52.610337 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-eb40b7ed-f7d9-401b-a048-0330c3ae6944 req-db2359b4-58c2-471f-9ec5-458096b912fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:52.618762 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-eb40b7ed-f7d9-401b-a048-0330c3ae6944 req-db2359b4-58c2-471f-9ec5-458096b912fe service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:52.619189 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-eb40b7ed-f7d9-401b-a048-0330c3ae6944 req-db2359b4-58c2-471f-9ec5-458096b912fe service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:52.633607 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-eb40b7ed-f7d9-401b-a048-0330c3ae6944 req-db2359b4-58c2-471f-9ec5-458096b912fe service nova] Creating event network-changed:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:21:52.638666 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-eb40b7ed-f7d9-401b-a048-0330c3ae6944 req-db2359b4-58c2-471f-9ec5-458096b912fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Jun 21 03:21:52.639322 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 605/1181] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:21:53.507347 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-edce25df-f719-4c35-8120-e58a53f06b77 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] Calling method '.version_select at 0x7fe79a5ef5e0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:53.531659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-edce25df-f719-4c35-8120-e58a53f06b77 tempest-TestVolumeBootPattern-1376634511 tempest-TestVolumeBootPattern-1376634511-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782746954" status: 202 len: 0 microversion: 2.1 time: 0.028349 Jun 21 03:21:53.532288 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 577/1182] 10.222.0.16 () {58 vars in 1262 bytes} [Tue Jun 21 03:21:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782746954 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:21:54.375314 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-281417469"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:54.376636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:54.383851 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:54.384660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:54.385675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:54.386326 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:54.609732 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.network.security_group_api [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Adding security group 5d0275d5-f147-4c23-bea8-fa879fbc56f9 to port 4c7cd145-f55d-411f-9d56-f4f86a8cec19 Jun 21 03:21:55.277199 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-3bf6a042-2571-400d-b41a-609ef3d82682 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/action" status: 202 len: 0 microversion: 2.1 time: 0.908509 Jun 21 03:21:55.277905 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 606/1183] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:21:54 2022] POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:21:55.286738 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:55.287370 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:55.297397 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:55.298434 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:55.301545 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:55.303190 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:55.354476 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-e63b37b2-f59e-4ed8-b39d-ef91115cb487 req-72367670-3de3-4210-b253-4efeeec29089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:55.380275 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-e63b37b2-f59e-4ed8-b39d-ef91115cb487 req-72367670-3de3-4210-b253-4efeeec29089 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:55.382678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-e63b37b2-f59e-4ed8-b39d-ef91115cb487 req-72367670-3de3-4210-b253-4efeeec29089 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:55.408396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-e63b37b2-f59e-4ed8-b39d-ef91115cb487 req-72367670-3de3-4210-b253-4efeeec29089 service nova] Creating event network-changed:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:21:55.415711 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-e63b37b2-f59e-4ed8-b39d-ef91115cb487 req-72367670-3de3-4210-b253-4efeeec29089 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064832 Jun 21 03:21:55.416660 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 607/1184] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:21:55.809421 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:55.822132 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7f6c8ff7-539f-424c-b28e-96a01e45aec6 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1760 microversion: 2.1 time: 0.539717 Jun 21 03:21:55.824745 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 578/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:55 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1760 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:56.997236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1883338416", "imageRef": "388b784a-f2c1-4efe-a36a-95f42e0c6c24", "flavorRef": "452"}} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:21:57.054333 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.network.neutron [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] validate_networks() for None {{(pid=117663) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 03:21:57.715945 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Flavor limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 03:21:57.716775 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Image limits 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 03:21:57.717354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Flavor pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 03:21:57.718366 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Image pref 0:0:0 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 03:21:57.718915 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.virt.hardware [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 03:21:57.732254 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:57.732810 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:57.733705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:57.734356 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:57.763173 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Getting quotas for project f41d09ea2ec147cfafda6ee66cd063f4. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 03:21:57.771752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.quota [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Getting quotas for user 811a703e4b684cbd9191be87e5a2cdd4 and project f41d09ea2ec147cfafda6ee66cd063f4. Resources: {'cores', 'ram', 'instances'} {{(pid=117663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 03:21:57.791005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Going to run 1 instances... {{(pid=117663) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 03:21:57.793544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='388b784a-f2c1-4efe-a36a-95f42e0c6c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 03:21:57.849763 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0aaad584-05f9-44c4-9e69-dd9b101089b1 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857491 Jun 21 03:21:57.850869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 608/1186] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jun 21 03:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 03:21:57.860659 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8354f8eb-7033-4820-919b-e7df43ab6646 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:57.861421 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8354f8eb-7033-4820-919b-e7df43ab6646 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:57.932892 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8354f8eb-7033-4820-919b-e7df43ab6646 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:57.941092 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8354f8eb-7033-4820-919b-e7df43ab6646 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1215 microversion: 2.1 time: 0.084384 Jun 21 03:21:57.941678 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 579/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:57 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:21:58.959104 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:21:58.960506 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:21:58.968163 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:58.968940 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:58.970154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:21:58.970759 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:21:59.059085 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:21:59.070135 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dac83369-fce4-4c82-bf79-f1dc98078559 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1275 microversion: 2.1 time: 0.115109 Jun 21 03:21:59.071043 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 609/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:21:58 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:00.088441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:00.089093 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:00.098115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:00.098657 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:00.099518 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:00.100030 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:00.224612 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:00.232444 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-19d2e251-89d3-4028-b469-017aabd2fd76 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1273 microversion: 2.1 time: 0.148517 Jun 21 03:22:00.233045 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 580/1189] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:00 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:01.251888 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:01.252318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:01.259866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:01.260565 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:01.261521 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:01.262148 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:01.462016 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:01.474406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-b2d8e628-7063-4428-96df-9ebabeb263f0 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.228320 Jun 21 03:22:01.488236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 610/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:01 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:01.721014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-8636ed2c-f884-455e-80ef-3b88865e3beb req-e1dbe9b6-cfd7-4243-a96d-6bbc6afaf82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f96f76-4fe8-40c0-a870-58fbcc1daa0a", "tag": "b8d005cc-2d8d-4d73-bba2-e1b0b76bb370"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:22:01.749358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8636ed2c-f884-455e-80ef-3b88865e3beb req-e1dbe9b6-cfd7-4243-a96d-6bbc6afaf82d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:01.749802 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8636ed2c-f884-455e-80ef-3b88865e3beb req-e1dbe9b6-cfd7-4243-a96d-6bbc6afaf82d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:01.774330 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-8636ed2c-f884-455e-80ef-3b88865e3beb req-e1dbe9b6-cfd7-4243-a96d-6bbc6afaf82d service nova] Creating event network-changed:b8d005cc-2d8d-4d73-bba2-e1b0b76bb370 for instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a on hv-cinder-84684 Jun 21 03:22:01.780143 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-8636ed2c-f884-455e-80ef-3b88865e3beb req-e1dbe9b6-cfd7-4243-a96d-6bbc6afaf82d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070915 Jun 21 03:22:01.781576 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 581/1191] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:22:02.493086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:02.493685 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:02.500365 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:02.501005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:02.501770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:02.502201 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:02.633493 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:02.641764 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-69b95e92-21e9-458d-a060-418545b2002e tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.152823 Jun 21 03:22:02.642517 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 611/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:02 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:03.665032 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:03.666189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:03.675043 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:03.675485 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:03.676244 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:03.676707 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:03.821234 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:03.829196 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eec71b3e-c7c4-42f0-b4e1-3ec0945d5bc8 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.171920 Jun 21 03:22:03.829756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 582/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:03 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:04.846538 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:04.847970 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:04.855034 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:04.855483 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:04.856249 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:04.856695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:05.003348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:05.014735 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-52fbf79b-3510-4343-a666-3f2ab64f60a2 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.172103 Jun 21 03:22:05.015482 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 612/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:04 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:06.036245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:06.036950 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:06.039567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:06.045353 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:06.045835 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:06.046632 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:06.047083 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:06.194024 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:06.201870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-43c77ab9-e475-440a-ae7a-161911266f0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.172631 Jun 21 03:22:06.202437 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 583/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:06 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:07.221419 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:07.222302 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:07.225969 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:07.234183 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:07.234803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:07.235869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:07.236295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:07.393142 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:07.401127 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ef322959-5d1f-4903-85fb-aa2b0660d794 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.185775 Jun 21 03:22:07.401695 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 613/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:07 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:07.851618 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-234df818-0790-4a8c-b5dd-9d9d629ebac6 req-d6cfa00c-6525-49f8-8ff8-4966c0ce34f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f96f76-4fe8-40c0-a870-58fbcc1daa0a", "name": "network-vif-plugged", "status": "completed", "tag": "b8d005cc-2d8d-4d73-bba2-e1b0b76bb370"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:22:07.860398 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-234df818-0790-4a8c-b5dd-9d9d629ebac6 req-d6cfa00c-6525-49f8-8ff8-4966c0ce34f9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:07.861177 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-234df818-0790-4a8c-b5dd-9d9d629ebac6 req-d6cfa00c-6525-49f8-8ff8-4966c0ce34f9 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:07.873676 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-234df818-0790-4a8c-b5dd-9d9d629ebac6 req-d6cfa00c-6525-49f8-8ff8-4966c0ce34f9 service nova] Creating event network-vif-plugged:b8d005cc-2d8d-4d73-bba2-e1b0b76bb370 for instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a on hv-cinder-84684 Jun 21 03:22:07.880496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-234df818-0790-4a8c-b5dd-9d9d629ebac6 req-d6cfa00c-6525-49f8-8ff8-4966c0ce34f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031695 Jun 21 03:22:07.881129 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 584/1197] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:22:08.422290 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:08.426387 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:08.429809 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=2 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:08.431344 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell0:SELECT=6 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:08.442922 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:08.443368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:08.444135 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:08.444598 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:08.594615 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:08.602895 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0fa876c6-c46d-4777-bfe5-fba600949824 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.187654 Jun 21 03:22:08.603469 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 614/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:08 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:09.625141 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:09.626299 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:09.629382 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:09.639651 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:09.640375 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:09.641664 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:09.642261 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:09.785245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:09.793269 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e3862300-5f88-4757-888b-073b83492c29 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1315 microversion: 2.1 time: 0.175157 Jun 21 03:22:09.793790 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 585/1199] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:09 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:10.814738 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:10.815384 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:10.822318 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:10.822753 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:10.823498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:10.823927 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:10.964358 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:10.972705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-586b2f16-f27c-4682-afb2-5c0963d9b910 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1465 microversion: 2.1 time: 0.164247 Jun 21 03:22:10.973269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 615/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:10 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:11.013785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:11.014310 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:11.021730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:11.022179 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:11.022946 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:11.023395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:11.049084 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:22:11.132011 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8bd5b4d9-bd01-497b-97ca-1ffe93c0bf0b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 204 len: 0 microversion: 2.1 time: 0.121776 Jun 21 03:22:11.132591 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 586/1201] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:22:11 2022] DELETE /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:22:11.141192 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:11.141803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:11.148137 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:11.148656 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:11.149423 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:11.149881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:11.297542 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:11.305860 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-1107f64c-21ec-495a-8ddc-997507158da7 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1471 microversion: 2.1 time: 0.168551 Jun 21 03:22:11.306422 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 616/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:11 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:12.328471 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:12.329530 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:12.339604 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:12.340284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:12.341491 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:12.342151 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:12.490994 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:12.499004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8a324618-5145-4e75-8c6a-312659476f10 tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1471 microversion: 2.1 time: 0.177257 Jun 21 03:22:12.499569 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 587/1203] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:12 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:13.238386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-c5c6d992-0d7d-459b-92b7-7c93ab64bf87 req-50952323-c819-459f-9bed-0f063beccb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f96f76-4fe8-40c0-a870-58fbcc1daa0a", "name": "network-vif-deleted", "tag": "b8d005cc-2d8d-4d73-bba2-e1b0b76bb370"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:22:13.251983 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-c5c6d992-0d7d-459b-92b7-7c93ab64bf87 req-50952323-c819-459f-9bed-0f063beccb1e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:13.252451 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-c5c6d992-0d7d-459b-92b7-7c93ab64bf87 req-50952323-c819-459f-9bed-0f063beccb1e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:13.264086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-c5c6d992-0d7d-459b-92b7-7c93ab64bf87 req-50952323-c819-459f-9bed-0f063beccb1e service nova] Creating event network-vif-deleted:b8d005cc-2d8d-4d73-bba2-e1b0b76bb370 for instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a on hv-cinder-84684 Jun 21 03:22:13.269744 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-c5c6d992-0d7d-459b-92b7-7c93ab64bf87 req-50952323-c819-459f-9bed-0f063beccb1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037781 Jun 21 03:22:13.270634 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 617/1204] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:22:13.516504 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:13.517780 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:13.524583 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:13.525671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:13.526438 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:13.526847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:13.557811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:13.558250 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:13.558692 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lazy-loading 'fault' on Instance uuid 27f96f76-4fe8-40c0-a870-58fbcc1daa0a {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:22:13.599340 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811a703e4b684cbd9191be87e5a2cdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41d09ea2ec147cfafda6ee66cd063f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:13.607228 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-274ed3dc-3dcb-4de5-b0cc-b5ccb9120a5c tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 200 len: 1305 microversion: 2.1 time: 0.094471 Jun 21 03:22:13.607870 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 588/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:13 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:14.631433 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:14.632639 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] [instance: 27f96f76-4fe8-40c0-a870-58fbcc1daa0a] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:14.643182 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:14.643638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:14.644418 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:14.644881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:14.659080 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] HTTP exception thrown: Instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a could not be found. Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Request method failure captured: Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a HTTP/1.1 Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTlTkvnvqD1b2Yg98vxQUZQIiP3jh3mMUxWShkuPX1mgknIlvqxLnwLkp5R1po6g6u93bPBuZ5SN7vcbnQ0jIpej_DRytGt57CEsk3dp8KD_RVWkQ9361dF0O0fizSRGIPuReeQ5KvJty9cURWwxLObQPbnSXIfAjf6qA-t7UUOsNTg Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: f41d09ea2ec147cfafda6ee66cd063f4 Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-VolumesNegativeTest-470272452 Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:22:14.660724 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f41d09ea2ec147cfafda6ee66cd063f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f41d09ea2ec147cfafda6ee66cd063f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f41d09ea2ec147cfafda6ee66cd063f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f41d09ea2ec147cfafda6ee66cd063f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-VolumesNegativeTest-470272452 Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: f41d09ea2ec147cfafda6ee66cd063f4 Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-VolumesNegativeTest-470272452 Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-VolumesNegativeTest-470272452-project Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 811a703e4b684cbd9191be87e5a2cdd4 Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-VolumesNegativeTest-470272452-project Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a could not be found. Jun 21 03:22:14.662354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '27f96f76-4fe8-40c0-a870-58fbcc1daa0a'} Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a could not be found. Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:22:14.663266 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a could not be found. Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a could not be found. Jun 21 03:22:14.664929 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:22:14.666393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] Returning 404 to user: Instance 27f96f76-4fe8-40c0-a870-58fbcc1daa0a could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:22:14.666393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-33a7a454-997a-4f90-97f9-dab1ae14392b tempest-VolumesNegativeTest-470272452 tempest-VolumesNegativeTest-470272452-project] 10.222.0.16 "GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a" status: 404 len: 111 microversion: 2.1 time: 0.038612 Jun 21 03:22:14.666393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 618/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:14 2022] GET /compute/v2.1/servers/27f96f76-4fe8-40c0-a870-58fbcc1daa0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:22:56.325592 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:22:56.326773 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:56.329496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:56.330328 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:56.340064 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:56.340734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:56.341923 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:56.342523 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:56.426703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-548e4957-2072-47a0-b67e-9b5808370ba5 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/action" status: 202 len: 0 microversion: 2.1 time: 0.107117 Jun 21 03:22:56.427391 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 589/1207] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:22:56 2022] POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:22:56.435806 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:56.436388 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:56.438755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=11 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:56.439406 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=78 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:22:56.446079 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:56.446524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:56.447251 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:56.447705 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:56.598777 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:56.606961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-ede7e88e-ad9f-4506-ac62-53d854d7d435 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1752 microversion: 2.1 time: 0.175024 Jun 21 03:22:56.607518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 619/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:56 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 03:22:57.630513 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:57.631169 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:57.638014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:57.638456 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:57.639208 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:57.639630 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:57.802989 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:57.816052 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5b52135a-9359-430b-9d49-56c9742c78cd tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.193039 Jun 21 03:22:57.816943 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 590/1209] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:57 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:22:58.836078 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:22:58.836778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:22:58.844347 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:58.844832 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:58.845585 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:22:58.846022 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:22:59.004638 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:22:59.017255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-95740e89-9899-4d54-8f60-344536a59363 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.185882 Jun 21 03:22:59.018033 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 620/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:22:58 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:00.039829 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:00.040843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:00.052260 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:00.053113 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:00.054379 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:00.055104 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:00.206646 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:00.215080 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b8ad107b-ff1f-45f6-8cd6-c2684e40d319 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.181960 Jun 21 03:23:00.215616 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 591/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:00 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:01.236624 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:01.237636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:01.246010 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:01.246459 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:01.247214 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:01.247643 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:01.390967 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:01.399846 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dd3dd637-6a63-4cec-bc22-672415f7747d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.169730 Jun 21 03:23:01.400442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 621/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:01 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:02.421506 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:02.422435 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:02.432900 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:02.433634 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:02.434867 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:02.435579 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:02.592051 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:02.604235 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fa0e4912-761f-47e2-8c34-fab4a6dcaa70 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.189087 Jun 21 03:23:02.604976 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 592/1213] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:02 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:03.625939 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:03.627188 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:03.635750 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:03.636198 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:03.637009 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:03.637442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:03.797591 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:03.810343 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4dc7b03a-f325-464b-8f22-7cd40b2370c9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.190578 Jun 21 03:23:03.811154 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 622/1214] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:03 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:04.833821 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:04.834734 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:04.841803 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:04.842250 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:04.843013 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:04.843442 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:04.995452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:05.007888 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fe0bf25f-f300-4a37-b2a1-6144bcb93f96 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.180324 Jun 21 03:23:05.008710 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 593/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:04 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:06.030200 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:06.030781 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:06.037793 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:06.038242 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:06.039029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:06.039457 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:06.213403 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:06.226303 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a09a6fc8-ff44-4464-8865-175ad4bf9951 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.199734 Jun 21 03:23:06.227101 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 623/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:06 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:07.253049 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:07.254046 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:07.265380 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:07.266116 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:07.267405 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:07.268079 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:07.428322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:07.440532 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cc8bb1f7-4f58-4105-a659-d5c53fdf3054 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.193814 Jun 21 03:23:07.441393 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 594/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:07 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:08.459058 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:08.459680 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:08.466829 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:08.467269 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:08.468017 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:08.468439 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:08.625059 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:08.634239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-14dac8cf-1d14-4832-b5ef-625ab9b83a3e tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.179235 Jun 21 03:23:08.634803 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 624/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:08 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:09.659284 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:09.660295 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:09.668119 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:09.668589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:09.669338 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:09.669764 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:09.828441 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:09.837515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-760e591a-7d7f-459b-bb1c-739a1a3e426b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.184531 Jun 21 03:23:09.837849 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 595/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:09 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:10.858597 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:10.859621 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:10.869596 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:10.870045 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:10.870812 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:10.871253 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:11.032737 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:11.045113 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-7f371ae5-c3a0-43a2-b522-e5de62db41ca tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.192742 Jun 21 03:23:11.045862 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 625/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:10 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:12.067189 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:12.068124 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:12.075687 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:12.076128 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:12.076936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:12.077345 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:12.223341 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:12.233785 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1032fc54-cd9a-437b-99fa-b126cd875645 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1757 microversion: 2.1 time: 0.173221 Jun 21 03:23:12.234358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 596/1221] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:12 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:13.252990 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:23:13.253725 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:23:13.262244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:13.262799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:13.263740 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:23:13.264282 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:23:13.421088 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:23:13.430430 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-bc573b3c-bcbb-471c-bf99-511a5ae746f3 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1760 microversion: 2.1 time: 0.182325 Jun 21 03:23:13.431015 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 626/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:23:13 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:23:51.765518 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:23:51.766743 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:23:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:23:55.874159 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:23:55.875407 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:23:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:23:58.233508 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:23:58.234276 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:24:03.472289 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:03.473227 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:03.476550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=16 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:24:03.477507 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:24:03.486606 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:03.487048 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:03.487806 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:03.488236 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:03.511819 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lazy-loading 'flavor' on Instance uuid 4e6043cc-7f42-49ff-b7d7-c30b743a6508 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:24:03.594223 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a6ab8f94-e136-43fc-a2c0-088315f45983 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "POST /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508/action" status: 202 len: 0 microversion: 2.1 time: 0.128694 Jun 21 03:24:03.594847 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 597/1223] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:24:03 2022] POST /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:24:03.601494 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=16 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:24:03.602354 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=48 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:24:03.606782 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:03.607385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:03.615319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:03.616194 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:03.617357 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:03.617789 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:03.943836 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:03.951918 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-76ee5a6e-fc60-472e-a621-6d4197a376da tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.351830 Jun 21 03:24:03.952462 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 627/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:03 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:04.975000 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:04.976155 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:04.986843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:04.987279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:04.988026 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:04.988477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:05.198142 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:05.205898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f580f363-7c83-490c-b109-46fff7b290bc tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.238796 Jun 21 03:24:05.206466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 598/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:04 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:06.225572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:06.226167 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:06.236443 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:06.237156 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:06.238382 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:06.239069 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:06.389122 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:06.397026 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-114eacd9-d10d-4554-bfc3-63afcd89155a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.175932 Jun 21 03:24:06.397562 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 628/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:06 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:07.418470 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:07.419395 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:07.431068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:07.431706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:07.433050 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:07.433703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:07.567756 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:07.579575 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d759eb3b-6ce4-4498-b33b-84d2cab6859f tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.167306 Jun 21 03:24:07.580156 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 599/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:07 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:08.607308 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:08.608219 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:08.616335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:08.616818 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:08.617575 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:08.618005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:08.756788 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:08.764440 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-06dec940-b8a5-4561-bfd5-d6ddf40a7ce1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.163898 Jun 21 03:24:08.765024 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 629/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:08 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:08.897677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-281417469"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:08.898359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:08.906987 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:08.907703 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:08.908495 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:08.908930 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:09.047476 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.network.security_group_api [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Removing security group 5d0275d5-f147-4c23-bea8-fa879fbc56f9 from port 4c7cd145-f55d-411f-9d56-f4f86a8cec19 Jun 21 03:24:09.415285 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d2507984-dd1b-4cf0-9789-36b13a00a986 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/action" status: 202 len: 0 microversion: 2.1 time: 0.522507 Jun 21 03:24:09.423525 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 600/1229] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:24:08 2022] POST /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:24:09.429110 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-eac3a3bf-8305-411e-9357-d6b4037726ce req-2981435d-2bdf-4ed5-8217-6869cc65de53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:09.440556 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-eac3a3bf-8305-411e-9357-d6b4037726ce req-2981435d-2bdf-4ed5-8217-6869cc65de53 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:09.441602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-eac3a3bf-8305-411e-9357-d6b4037726ce req-2981435d-2bdf-4ed5-8217-6869cc65de53 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:09.456691 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-eac3a3bf-8305-411e-9357-d6b4037726ce req-2981435d-2bdf-4ed5-8217-6869cc65de53 service nova] Creating event network-changed:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:24:09.464589 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-eac3a3bf-8305-411e-9357-d6b4037726ce req-2981435d-2bdf-4ed5-8217-6869cc65de53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040331 Jun 21 03:24:09.465869 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 630/1230] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:24:09.784402 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:09.785148 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:09.792699 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:09.793279 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:09.794126 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:09.794671 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:10.094134 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:10.103524 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-08bb8515-0831-4620-9b43-f4460eb314cd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.324929 Jun 21 03:24:10.104058 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 601/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:09 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:11.122813 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:11.123675 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:11.131450 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.131894 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.132680 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.133247 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.164425 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:11.165621 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:11.172286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.172936 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.174261 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.174869 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.261212 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lazy-loading 'services' on Instance uuid ea047bac-ae1c-498e-8857-96d0c7d2cb74 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 03:24:11.288211 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:11.297196 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f3a46153-cd62-422f-b5c5-1d9829bb2e49 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.178707 Jun 21 03:24:11.299528 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 631/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:11 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:11.349014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6ac9f65c-29cf-4e1e-900e-7e565ef9d34d tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments/9aa1666e-2df9-4165-b11c-049d13e42100" status: 202 len: 0 microversion: 2.1 time: 0.188912 Jun 21 03:24:11.349991 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 602/1233] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:24:11 2022] DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments/9aa1666e-2df9-4165-b11c-049d13e42100 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 03:24:11.358892 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:11.359377 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:11.366785 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.367165 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.368003 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.368498 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.400955 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-d3d82aec-b9ce-444f-aaca-766b84ebc34f tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Jun 21 03:24:11.404854 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 632/1234] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:24:11 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 03:24:11.483320 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-bd90c05f-d5ae-4372-8bb2-e4a934016512 req-8604ee39-1ae1-48c7-a4bc-ff215b985240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:11.492392 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-bd90c05f-d5ae-4372-8bb2-e4a934016512 req-8604ee39-1ae1-48c7-a4bc-ff215b985240 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:11.492854 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-bd90c05f-d5ae-4372-8bb2-e4a934016512 req-8604ee39-1ae1-48c7-a4bc-ff215b985240 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:11.503880 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-bd90c05f-d5ae-4372-8bb2-e4a934016512 req-8604ee39-1ae1-48c7-a4bc-ff215b985240 service nova] Creating event network-changed:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:24:11.508904 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-bd90c05f-d5ae-4372-8bb2-e4a934016512 req-8604ee39-1ae1-48c7-a4bc-ff215b985240 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029732 Jun 21 03:24:11.509714 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 603/1235] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:24:12.315601 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:12.316359 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:12.323191 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:12.324070 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:12.324861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:12.325305 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:12.413825 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:12.415255 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:12.422741 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:12.423221 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:12.424100 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:12.424690 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:12.454841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9e477c39-9e91-49c7-a13d-e691f29e76c2 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045340 Jun 21 03:24:12.455418 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 604/1236] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jun 21 03:24:12 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 03:24:12.465338 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:12.465826 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:12.472247 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:12.472719 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:12.473479 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:12.473910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:12.476141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:12.483848 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-4e871505-f2d0-49b4-aa1b-39ed22aa5cb1 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.172364 Jun 21 03:24:12.484422 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 633/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:12 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:12.546795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] HTTP exception thrown: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 is not attached to volume 9aa1666e-2df9-4165-b11c-049d13e42100 Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Request method failure captured: Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments/9aa1666e-2df9-4165-b11c-049d13e42100 HTTP/1.1 Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept: application/json Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Connection: close Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Host: 10.222.0.16 Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABisTkMtN94OmjeoPA7vWz_Tfuml1imnzooRH4DHnOT5CvCjGTk5Y4hKGLkaeFLPhHk_fSIryTfC8IMfKp3nF6O6AnVyV79A4AFOc_uzsQUxX8_Yip9FNgLtgobT3ZchUKEO-OG_2FsU0-R_JhYtMjBrxKiKjSVqudJ09f7f0u6ftC9OWA Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Id: 5e57658c9c9340adba6ab15050b24e8a Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestMinimumBasicScenario-338657067 Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Role: reader,member Jun 21 03:24:12.549404 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Roles: reader,member Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e57658c9c9340adba6ab15050b24e8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e57658c9c9340adba6ab15050b24e8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e57658c9c9340adba6ab15050b24e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e57658c9c9340adba6ab15050b24e8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestMinimumBasicScenario-338657067 Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 5e57658c9c9340adba6ab15050b24e8a Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-338657067 Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User: tempest-TestMinimumBasicScenario-338657067-project Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Id: 994fd8a1975c45a8a65ace3d090d1ff5 Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestMinimumBasicScenario-338657067-project Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: method: > Jun 21 03:24:12.551200 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: exception: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 is not attached to volume 9aa1666e-2df9-4165-b11c-049d13e42100 Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: action_args: {'server_id': 'ea047bac-ae1c-498e-8857-96d0c7d2cb74', 'id': '9aa1666e-2df9-4165-b11c-049d13e42100'} Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9aa1666e-2df9-4165-b11c-049d13e42100. Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:24:12.552161 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 is not attached to volume 9aa1666e-2df9-4165-b11c-049d13e42100 Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 is not attached to volume 9aa1666e-2df9-4165-b11c-049d13e42100 Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jun 21 03:24:12.553833 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Returning 404 to user: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 is not attached to volume 9aa1666e-2df9-4165-b11c-049d13e42100 {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:24:12.555094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4b00a5aa-fc7e-45fc-bdbd-7dc47b4102b9 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments/9aa1666e-2df9-4165-b11c-049d13e42100" status: 404 len: 154 microversion: 2.1 time: 0.089370 Jun 21 03:24:12.555094 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 605/1238] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jun 21 03:24:12 2022] DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74/os-volume_attachments/9aa1666e-2df9-4165-b11c-049d13e42100 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:24:13.505386 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:13.506086 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:13.512981 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:13.513425 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:13.514171 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:13.514608 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:13.667636 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:13.676295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-10e22435-db67-4a36-9e53-fb175bcd9c3b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.176679 Jun 21 03:24:13.676886 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 634/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:13 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:13.696872 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:13.697413 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:13.704526 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:13.704972 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:13.705715 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:13.706145 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:13.732197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:24:13.814150 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-29cce32a-60c9-44d2-ac30-56b4437ed820 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 204 len: 0 microversion: 2.1 time: 0.120772 Jun 21 03:24:13.814642 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 606/1240] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:24:13 2022] DELETE /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 03:24:13.823285 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:13.823910 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:13.830239 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:13.830678 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:13.831502 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:13.831968 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:13.968203 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:13.978790 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-dda700ca-8963-4daf-a728-d66ccdc1109b tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1555 microversion: 2.1 time: 0.159453 Jun 21 03:24:13.979556 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 635/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:13 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:14.698725 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:14.699898 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:14.709677 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:14.710122 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:14.710884 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:14.711288 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:14.853740 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:14.866474 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fa095a64-d019-4023-9e5b-cfd01e571a89 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.174479 Jun 21 03:24:14.867369 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 607/1242] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:14 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:14.998033 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:14.998602 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:15.005679 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:15.006121 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:15.006875 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:15.007302 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:15.148368 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:15.156463 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-8367215d-cc9f-45f8-990c-1dfeb6dba053 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1555 microversion: 2.1 time: 0.162445 Jun 21 03:24:15.157025 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 636/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:14 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:15.889611 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:15.890401 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:15.898882 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:15.899359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:15.900140 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:15.900601 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:16.045112 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:16.052935 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8273d766-8524-483a-9e50-09245fc45f7b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.167976 Jun 21 03:24:16.053496 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 608/1244] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:15 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:16.178432 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:16.179081 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:16.185642 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:16.186084 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:16.186820 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:16.187248 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:16.328533 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:16.339841 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0e6d1471-19e7-4429-96a4-6a28a2f76bb8 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1555 microversion: 2.1 time: 0.167794 Jun 21 03:24:16.340655 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 637/1245] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:16 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:17.071340 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:17.071920 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:17.080868 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:17.081315 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:17.082061 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:17.082488 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:17.307983 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:17.315993 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0862e68e-c37d-4eef-b48e-2cf7b84177bd tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.248629 Jun 21 03:24:17.316511 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 609/1246] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:17 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:17.359170 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:17.360448 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:17.367545 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:17.367987 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:17.368770 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:17.369177 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:17.506006 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994fd8a1975c45a8a65ace3d090d1ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e57658c9c9340adba6ab15050b24e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:17.514190 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-da7662c0-e1f8-4a20-903d-f98acb73a6be tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 200 len: 1555 microversion: 2.1 time: 0.158812 Jun 21 03:24:17.524042 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 638/1247] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:17 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:17.572301 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-82282da1-aa58-4b6e-bef5-e690761e2419 req-643770c6-d264-45ca-a46d-ff1c5c465f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea047bac-ae1c-498e-8857-96d0c7d2cb74", "name": "network-vif-deleted", "tag": "4c7cd145-f55d-411f-9d56-f4f86a8cec19"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:17.581452 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-82282da1-aa58-4b6e-bef5-e690761e2419 req-643770c6-d264-45ca-a46d-ff1c5c465f0d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:17.581970 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-82282da1-aa58-4b6e-bef5-e690761e2419 req-643770c6-d264-45ca-a46d-ff1c5c465f0d service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:17.586160 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:24:17.594515 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-82282da1-aa58-4b6e-bef5-e690761e2419 req-643770c6-d264-45ca-a46d-ff1c5c465f0d service nova] Creating event network-vif-deleted:4c7cd145-f55d-411f-9d56-f4f86a8cec19 for instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 on hv-cinder-84684 Jun 21 03:24:17.599451 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-82282da1-aa58-4b6e-bef5-e690761e2419 req-643770c6-d264-45ca-a46d-ff1c5c465f0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030847 Jun 21 03:24:17.600541 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 610/1248] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:24:18.333870 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:18.334593 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:18.341430 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.341881 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.342645 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.343076 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.476125 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:18.484158 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-f1f9de5e-6963-47a7-add1-4448afcbab46 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1570 microversion: 2.1 time: 0.154295 Jun 21 03:24:18.484772 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 639/1249] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:18 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:18.504841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:18.505668 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:18.513286 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.513727 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.514477 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.514910 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.531071 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:18.531676 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] [instance: ea047bac-ae1c-498e-8857-96d0c7d2cb74] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:18.537791 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.538236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.539074 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.539544 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.553755 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] HTTP exception thrown: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 could not be found. Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Request method failure captured: Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 HTTP/1.1 Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTkMtN94OmjeoPA7vWz_Tfuml1imnzooRH4DHnOT5CvCjGTk5Y4hKGLkaeFLPhHk_fSIryTfC8IMfKp3nF6O6AnVyV79A4AFOc_uzsQUxX8_Yip9FNgLtgobT3ZchUKEO-OG_2FsU0-R_JhYtMjBrxKiKjSVqudJ09f7f0u6ftC9OWA Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 5e57658c9c9340adba6ab15050b24e8a Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-TestMinimumBasicScenario-338657067 Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:24:18.555653 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e57658c9c9340adba6ab15050b24e8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e57658c9c9340adba6ab15050b24e8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e57658c9c9340adba6ab15050b24e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e57658c9c9340adba6ab15050b24e8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-TestMinimumBasicScenario-338657067 Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 5e57658c9c9340adba6ab15050b24e8a Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-TestMinimumBasicScenario-338657067 Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-TestMinimumBasicScenario-338657067-project Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: 994fd8a1975c45a8a65ace3d090d1ff5 Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-TestMinimumBasicScenario-338657067-project Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 could not be found. Jun 21 03:24:18.557385 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': 'ea047bac-ae1c-498e-8857-96d0c7d2cb74'} Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 could not be found. Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:24:18.558396 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 could not be found. Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 could not be found. Jun 21 03:24:18.560205 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:24:18.561826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Returning 404 to user: Instance ea047bac-ae1c-498e-8857-96d0c7d2cb74 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:24:18.561826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-5c0e9c9e-fc95-421f-b4e6-b1046b23a7f0 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74" status: 404 len: 111 microversion: 2.1 time: 0.029935 Jun 21 03:24:18.561826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 640/1250] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:18 2022] GET /compute/v2.1/servers/ea047bac-ae1c-498e-8857-96d0c7d2cb74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:24:18.566421 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-02dea3bc-f7d4-4bac-98f8-34881473bb28 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] Calling method '.version_select at 0x7fe79a138f70>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:18.588960 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-02dea3bc-f7d4-4bac-98f8-34881473bb28 tempest-TestMinimumBasicScenario-338657067 tempest-TestMinimumBasicScenario-338657067-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1205730609" status: 202 len: 0 microversion: 2.1 time: 0.026083 Jun 21 03:24:18.589559 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 641/1251] 10.222.0.16 () {58 vars in 1271 bytes} [Tue Jun 21 03:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1205730609 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 03:24:18.656215 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-73d14a20-fbfc-4e6b-9404-4a7a820a755d tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "POST /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508/action" status: 202 len: 0 microversion: 2.1 time: 0.158649 Jun 21 03:24:18.656949 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 611/1252] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jun 21 03:24:18 2022] POST /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 03:24:18.665752 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:18.666397 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:18.672484 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.672861 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.674141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:18.674572 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:18.828623 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:18.836857 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-c57cc7bb-0bcc-4ad6-bad3-fec928f1a054 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1518 microversion: 2.1 time: 0.175286 Jun 21 03:24:18.837840 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 642/1253] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:18 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:19.854730 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:19.855374 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:19.861613 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:19.862063 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:19.862798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:19.863221 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:20.099174 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:20.108647 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a510b861-d6a8-4d0d-9d24-467cb4cc884e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1520 microversion: 2.1 time: 0.258206 Jun 21 03:24:20.109217 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 612/1254] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:19 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:20.531186 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-84e7c407-8e21-486d-a1e8-86599d91995d req-a863d83a-89b1-4522-9b90-9d8667107da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "name": "network-vif-unplugged", "status": "completed", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:20.541880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-84e7c407-8e21-486d-a1e8-86599d91995d req-a863d83a-89b1-4522-9b90-9d8667107da1 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:20.542380 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-84e7c407-8e21-486d-a1e8-86599d91995d req-a863d83a-89b1-4522-9b90-9d8667107da1 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:20.554736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-84e7c407-8e21-486d-a1e8-86599d91995d req-a863d83a-89b1-4522-9b90-9d8667107da1 service nova] Creating event network-vif-unplugged:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:24:20.560255 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-84e7c407-8e21-486d-a1e8-86599d91995d req-a863d83a-89b1-4522-9b90-9d8667107da1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035240 Jun 21 03:24:20.561325 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 643/1255] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:24:21.126862 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:21.127482 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:21.135014 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:21.135466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:21.136245 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:21.136706 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:21.378361 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:21.386358 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-18c49bd5-d4d1-4d54-8473-948ab1aaa96b tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.263518 Jun 21 03:24:21.387296 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 613/1256] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:21 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:22.405348 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:22.406005 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:22.412961 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:22.413393 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:22.414295 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:22.414723 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:22.668761 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:22.677799 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-a02b5b78-cf06-4852-b267-9ae2d5c6a8c7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.277698 Jun 21 03:24:22.678324 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 644/1257] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:22 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:23.695498 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:23.696120 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:23.703154 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:23.703597 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:23.704322 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:23.704805 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:23.923082 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:23.931890 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-31091a2c-f1bb-4bdf-9452-ab7f61370cee tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.240460 Jun 21 03:24:23.932559 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 614/1258] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:23 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:24.950410 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:24.952067 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:24.958845 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:24.959287 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:24.960100 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:24.960661 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:25.106402 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:25.114700 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-25193702-3628-45c8-bf7c-83b40b27b21e tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.168703 Jun 21 03:24:25.115817 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 645/1259] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:24 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:26.132643 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:26.133967 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:26.145197 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:26.145793 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:26.146669 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:26.147199 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:26.309916 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:26.321288 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a6008f03-5ed4-4231-83d5-76b6a808d283 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.192643 Jun 21 03:24:26.331135 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 615/1260] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:26 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:27.339027 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:27.339593 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:27.346630 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:27.347072 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:27.347826 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:27.348246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:27.369590 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=100 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:24:27.487778 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:27.496651 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-efce6fb4-d42c-4c07-b6d7-3785427fb7aa tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.161702 Jun 21 03:24:27.508029 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 646/1261] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:27 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:28.514466 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:28.515115 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:28.522068 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:28.522523 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:28.523239 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:28.523686 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:28.663415 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:28.672752 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1b9c37d2-4553-4fd9-add7-813f7e8c5bd7 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.162454 Jun 21 03:24:28.673333 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 616/1262] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:28 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:29.690632 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:29.691244 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:29.698346 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:29.698791 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:29.699520 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:29.699974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:29.841229 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:29.852112 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-724e95d6-9359-4b44-a39f-74df0c7ad9ba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.165451 Jun 21 03:24:29.852710 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 647/1263] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:29 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:30.573962 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-d072900a-63a0-46b1-af98-9c8dff08d1c5 req-28ee928a-f750-4191-bd1d-9f96afbc374c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "name": "network-vif-plugged", "status": "completed", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:24:30.582864 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d072900a-63a0-46b1-af98-9c8dff08d1c5 req-28ee928a-f750-4191-bd1d-9f96afbc374c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:30.583299 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d072900a-63a0-46b1-af98-9c8dff08d1c5 req-28ee928a-f750-4191-bd1d-9f96afbc374c service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:30.597237 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-d072900a-63a0-46b1-af98-9c8dff08d1c5 req-28ee928a-f750-4191-bd1d-9f96afbc374c service nova] Creating event network-vif-plugged:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:24:30.603843 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-d072900a-63a0-46b1-af98-9c8dff08d1c5 req-28ee928a-f750-4191-bd1d-9f96afbc374c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033573 Jun 21 03:24:30.604494 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 617/1264] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:24:30.870012 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:30.870626 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:30.877335 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:30.877791 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:30.878546 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:30.878982 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:31.012959 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:31.020880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0aa28c65-7d02-4041-acb4-7c39b8796fba tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.155268 Jun 21 03:24:31.021453 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 648/1265] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:30 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:32.045091 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:32.046505 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:32.056321 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:32.056811 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:32.057567 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:32.057999 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:32.201376 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:32.209048 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b459db2b-98b3-4152-b914-ce8adac096e9 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1576 microversion: 2.1 time: 0.172587 Jun 21 03:24:32.209608 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 618/1266] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:32 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:24:33.227842 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:24:33.228427 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:24:33.236217 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:33.236800 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:33.237880 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:24:33.238465 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:24:33.388872 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:24:33.397082 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-2a88adea-d02a-4afe-8967-3f52ca9a2330 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1563 microversion: 2.1 time: 0.174093 Jun 21 03:24:33.397766 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 649/1267] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:24:33 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:26:00.309705 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:26:00.310360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:26:00.312338 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:26:00.313009 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:26:00.316373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:26:00.317378 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG dbcounter [-] [117663] Writing DB stats nova_cell1:SELECT=20 {{(pid=117663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 03:26:00.321136 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-f2f99558-ba29-43b9-8bc5-bf799399c49e req-a208d815-c903-4448-a30e-e32978693d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:26:00.329796 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-f2f99558-ba29-43b9-8bc5-bf799399c49e req-a208d815-c903-4448-a30e-e32978693d84 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:00.330210 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-f2f99558-ba29-43b9-8bc5-bf799399c49e req-a208d815-c903-4448-a30e-e32978693d84 service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:00.332396 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:00.332947 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:00.333922 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:00.335215 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:00.342373 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-f2f99558-ba29-43b9-8bc5-bf799399c49e req-a208d815-c903-4448-a30e-e32978693d84 service nova] Creating event network-changed:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:26:00.347646 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-f2f99558-ba29-43b9-8bc5-bf799399c49e req-a208d815-c903-4448-a30e-e32978693d84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Jun 21 03:26:00.348232 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 650/1268] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:26:00.364201 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 03:26:00.453088 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8f0bd236-d2ec-4d2b-a69a-24a5a34947c5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 204 len: 0 microversion: 2.1 time: 0.147919 Jun 21 03:26:00.454596 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 619/1269] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jun 21 03:26:00 2022] DELETE /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 03:26:00.463659 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:26:00.464622 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:26:00.470976 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:00.471722 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:00.472640 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:00.473131 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:00.612930 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.policy [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117663) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:26:00.621431 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-caaed31e-2055-40df-b5de-04e0baf408ad tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.162209 Jun 21 03:26:00.621998 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 651/1270] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:26:00 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:26:01.640139 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:26:01.640912 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:26:01.649004 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:01.649893 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:01.650175 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:01.650798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:01.855294 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:26:01.863359 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e66de578-0cb6-443d-8832-918df5100e8a tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1569 microversion: 2.1 time: 0.227987 Jun 21 03:26:01.863928 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 620/1271] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:26:01 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:26:02.700561 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [req-0ed2fb55-5559-4493-b08d-7968770a22b1 req-3ecb0b65-189f-4c25-8dd5-c30ab3df2d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6043cc-7f42-49ff-b7d7-c30b743a6508", "name": "network-vif-deleted", "tag": "77e657ce-c759-4da2-a7bb-cf9e5b28f113"}]} {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 03:26:02.710794 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-0ed2fb55-5559-4493-b08d-7968770a22b1 req-3ecb0b65-189f-4c25-8dd5-c30ab3df2d1e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:02.711166 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [req-0ed2fb55-5559-4493-b08d-7968770a22b1 req-3ecb0b65-189f-4c25-8dd5-c30ab3df2d1e service nova] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:02.722871 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.compute.server_external_events [req-0ed2fb55-5559-4493-b08d-7968770a22b1 req-3ecb0b65-189f-4c25-8dd5-c30ab3df2d1e service nova] Creating event network-vif-deleted:77e657ce-c759-4da2-a7bb-cf9e5b28f113 for instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 on hv-cinder-84684 Jun 21 03:26:02.728524 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [req-0ed2fb55-5559-4493-b08d-7968770a22b1 req-3ecb0b65-189f-4c25-8dd5-c30ab3df2d1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Jun 21 03:26:02.729212 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 652/1272] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jun 21 03:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 03:26:02.883813 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:26:02.884423 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:26:02.891346 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:02.891795 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:02.892589 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:02.893019 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:02.957933 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c55aee07d4447489ddedde5972ec58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775518eb8c104022b5acfd12ead0fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 03:26:02.966635 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b5947725-7327-4e33-bf66-668e921cf722 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 200 len: 1220 microversion: 2.1 time: 0.088243 Jun 21 03:26:02.967215 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 621/1273] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:26:02 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 03:26:03.984587 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '>' {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:26:03.985264 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.compute.api [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] [instance: 4e6043cc-7f42-49ff-b7d7-c30b743a6508] Fetching instance by UUID {{(pid=117663) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 03:26:03.992682 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:03.993120 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:03.993868 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 03:26:03.994289 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG oslo_concurrency.lockutils [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Lock "4968fc3d-d05a-41d1-aa8d-490f1ec89c5c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 03:26:04.007692 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.wsgi [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] HTTP exception thrown: Instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 could not be found. Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Request method failure captured: Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: request: GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 HTTP/1.1 Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept: application/json Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Accept-Encoding: identity Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Connection: close Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Length: 0 Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Content-Type: application/json Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Host: 10.222.0.16 Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Openstack-System-Scope: None Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: User-Agent: python-urllib3/1.26.9 Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Auth-Token: gAAAAABisTkOMSgtCjTyJVH0qwHw4Kd4TvoowH_spbJRc9wZq4G3QvXc-UlXgmBNEpe0CwJ_hfZjpNHb40VXOvJ4jylDgxEe0prt-KWxvTO0tlhAbMhBM4Qs6I3LVJIBnbTcJeULH2yqmMRqSH-29dwPSZtHp1TCEoNMhAb_IX0KiQN0eGdH3RA Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Id: None Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Domain-Name: None Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Identity-Status: Confirmed Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Is-Admin-Project: True Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Id: default Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Domain-Name: Default Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Id: 775518eb8c104022b5acfd12ead0fee5 Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Project-Name: tempest-TestShelveInstance-2006815363 Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Role: reader,member Jun 21 03:26:04.009319 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Roles: reader,member Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/775518eb8c104022b5acfd12ead0fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/775518eb8c104022b5acfd12ead0fee5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/775518eb8c104022b5acfd12ead0fee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_775518eb8c104022b5acfd12ead0fee5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant: tempest-TestShelveInstance-2006815363 Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Id: 775518eb8c104022b5acfd12ead0fee5 Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-Tenant-Name: tempest-TestShelveInstance-2006815363 Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User: tempest-TestShelveInstance-2006815363-project Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Id: default Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Domain-Name: Default Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Id: c3c55aee07d4447489ddedde5972ec58 Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: X-User-Name: tempest-TestShelveInstance-2006815363-project Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: method: > Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: exception: Instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 could not be found. Jun 21 03:26:04.011141 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: action_args: {'id': '4e6043cc-7f42-49ff-b7d7-c30b743a6508'} Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: {{(pid=117663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 could not be found. Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 03:26:04.012230 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 could not be found. Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 could not be found. Jun 21 03:26:04.013974 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: ERROR nova.api.openstack.wsgi Jun 21 03:26:04.015467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: DEBUG nova.api.openstack.wsgi [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Returning 404 to user: Instance 4e6043cc-7f42-49ff-b7d7-c30b743a6508 could not be found. {{(pid=117663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 03:26:04.015467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO nova.api.openstack.requestlog [None req-0652799c-ebe7-45d3-9d5e-bbad49a43dd5 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508" status: 404 len: 111 microversion: 2.1 time: 0.030388 Jun 21 03:26:04.015467 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: [pid: 117663|app: 0|req: 653/1274] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jun 21 03:26:03 2022] GET /compute/v2.1/servers/4e6043cc-7f42-49ff-b7d7-c30b743a6508 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 03:26:04.183256 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5b06143e-7104-416d-a58b-0c230839f180 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] Calling method '.version_select at 0x7fe79b775f70>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 03:26:04.203840 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5b06143e-7104-416d-a58b-0c230839f180 tempest-TestShelveInstance-2006815363 tempest-TestShelveInstance-2006815363-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2057338031" status: 202 len: 0 microversion: 2.1 time: 0.024464 Jun 21 03:26:04.204550 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 622/1275] 10.222.0.16 () {58 vars in 1253 bytes} [Tue Jun 21 03:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2057338031 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 03:27:11.779236 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:27:11.779866 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:27:15.888017 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:27:15.888674 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:27:18.244442 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:27:18.245097 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:27:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:28:47.757156 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:28:47.757841 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:29:17.029713 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:29:17.030798 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:30:31.789062 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:30:31.789779 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:30:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:30:35.898750 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:30:35.899360 dv-cinder-846842-1-iscsi devstack@n-api.service[117664]: Tue Jun 21 03:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:30:38.255222 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:30:38.255736 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:30:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 03:31:23.484246 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 03:31:23.485197 dv-cinder-846842-1-iscsi devstack@n-api.service[117663]: Tue Jun 21 03:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!